This is a list of web crawlers which have visited my main page between September 10, 2001 and June 9, 2002. A * indicates search output is not freely available.
| Hits | Agent | Output |
| 33 | Slurp/cat | Inktomi * |
| 11 | Googlebot | |
| 9 | ArchitextSpider | Excite |
| 9 | Pita | Pita * |
| 8 | FAST-WebCrawler | Fast |
| 8 | Scooter | Altavista |
| 7 | ia_archiver | Wayback |
| 5 | crawler | IBM Research * |
| 3 | psbot | Picsearch |
| 3 | Whizbang | WhizBang |
| 2 | Ask Jeeves | Ask Jeeves |
| 2 | SlySearch | Plagiarism |
| 2 | ZyBorg | Wisenut |
| 1 | ASSORT | Gang Xiao * |
| 1 | RRC | Bigfoot * |
| 1 | moget | Goo |
| 1 | tivraSpider | Ionaut |
| 1 | HenrytheMiragoRobot | Mirago |
| 1 | Openbot | Openfind |
| 1 | Fake IE | Sureseeker |
| 1 | W3CRobot | W3C * |
| 1 | cosmos | Xyleme |
Also, I have received six hits from machines using the larbin crawler, and one from the autoemailspider.
It is worth mentioning that among the crawlers feeding into public search engines, the frequency of hits does not seem to correlate very well with the quality of the search engine (although most of the 1-hit engines really suck), and hits don't seem to correspond to live database updates.