appie 1.1 (www.walhello.com)
blinker/incremental0.61
boitho.com-dc/0.73 ( http://www.boitho.com/dcbot.html )
ccubee/3.0
cfetch/1.0
ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl)
DoCoMo/2.0 P900i(c100;TB;W24H11)
DTAAgent
Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html)
eagle\r\nAccept: */* \r\nAccept-Language: en-us
e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/)
ExactSearch
FAST Enterprise Crawler/6.4 (helpdesk at fast.no)
FAST MetaWeb Crawler (helpdesk at fastsearch dot com)
Findexa Crawler (http://www.findexa.no/gulesider/article26548.ece)
findlinks/0.999 (+http://wortschatz.uni-leipzig.de/findlinks/)
Generic
geniebot wgao@genieknows.com
Gigabot/2.0
Helmdall (webmaster@crawler.com)
HooWWWer/2.1.0 (+http://cosco.hiit.fi/search/hoowwwer/ | mailto:crawler-infohiit.fi)
ichiro/1.0 (ichiro@nttr.co.jp)
InfociousBot (+http://corp.infocious.com/tech_crawler.php)
JiffeSearch/2.2.2 (www.jiffe.com)
Kapere (http://www.kapere.com)
LinkWalker
LWP::Simple/5.803
Matrix S.p.A. - FAST Enterprise Crawler 6 (Unknown admin e-mail address)
Microsoft URL Control - 6.01.9782
Missigua Locator 1.9
MJ12bot/v1.0.1 (http://majestic12.co.uk/bot.php?+)
Mozdex/0.06-dev (Mozdex; http://www.mozdex.com/bot.html; spider@mozdex.com)
NG/2.0
Nokia6610I/1.0 (4.20) Profile/MIDP-1.0 Configuration/CLDC-1.0 (Google WAP Proxy/1.0)
Nokia7650/1.0 SymbianOS/6.1 Series60/0.9 Profile/MIDP-1.0 Configuration/CLDC-1.0 (Google WAP Proxy/1.0)
NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)
Ocelli/1.3 (http://www.globalspec.com/Ocelli)
OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Internet Categorizer
OmniExplorer_Bot/2.83 (+http://www.omni-explorer.com) WorldIndexer
PHPCrawl
Pita (webmaster@pita.stanford.edu)
Randy
research-spider
Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au)
sherlock/1.0
snap.com beta crawler v0
SonyEricssonP900/R102 Profile/MIDP-2.0 Configuration/CLDC-1.0 Rev/MR4
Speedy Spider (Beta/1.0; www.entireweb.com)
tScholarsBot
Twiceler www.cuill.com/robots.html
UnChaosBot
Under the Rainbow 2.2
UP.Browser/6.1.0.1.140 (Google CHTML Proxy/1.0)
W3C-checklink/4.1 [4.14] libwww-perl/5.803
W3CRobot/5.4.0 libwww/5.4.0
w3search [babylon]
WebCopier v3.3
WebVac (webmaster@pita.stanford.edu WebVac.org )
Wget/1.8.2
Wget/1.9+cvs-stable (Red Hat modified)
Virgo/0.7 (-; http://virgo.tiedonhaku.fi/; n/a)
VUNETORG-Lynx
YottaShopping_Bot/4.12 (+http://www.yottashopping.com) Shopping Search Engine