Introduction
Banning spiders and agents
Search engine spider identification
Further learning resources:
If you've been surfing search engine optimization web sites, you've no doubt come across the term spider, robot or bot on many occasions.
Five terms all describing basically the same thing, but in this article they'll be referred to collectively as spiders or "agents". A search engine spider is an automated software program used to locate and collect data from web pages for inclusion in a search engine's database and to follow links to find new pages on the World Wide Web. The term "agent" is more commonly applied to web browsers and mirroring software.
Having all the major browsers becomes increasingly important for webmasters these days. A site may look very different in Internet Explorer, Netscape, Mozilla and Opera. So as Opera announced the release of their newest browser Opera 7, I was quick to download and install...
It gives Opera credit that less than a week after the release; they announced the release of the Opera 7.01... They were quick to fix some security issues that were present in the 7.0 version.
The first thing that strikes me in Opera 7 is the look and feel of the browser... The animated buttons are different from any other browser I've tried. And it doesn't seem like they ruin Operas reputation as the fastest browser around.