Bots vs Browsers : Public Bot / User Agent Database & Commentary

Bots vs Browsers - Public Bot / User Agent Database & Commentary

Home | Archives | About User Agents | User Agent Test Track | Recent Additions | Contributors | Donate | Top Searches | User Agent IP Directory

Bots vs Browsers - database of 1,418,534 user agents and growing

Browsing Category "All Bots"

All bots that we have identified belong to this category.

1000 User Agents Found.

Bot !?aTRASH proxyDIRECT - ( - Red Hat)

Bot !Susie (

Bot "<script>alert(/hi/)</script>"

Bot ">'><script><?php include(''); ?>&...

Bot ">'><script>alert(123)</script>

Bot ">'><script>alert(123)</script> FirePHP/0.3

Bot "><script>alert(/xss/)</script>

Bot "><script>alert(document.cookie)</script>

Bot "Googlebot/2.1 ("Mozilla/5.0 (compatible; Googlebot/2.1; http://ww...

Bot "Googlebot/2.1 ("Mozilla/5.0 (compatible; Googlebot/2.1; http://www...

Bot "Googlebot/2.1 ("Mozilla/5.0 (compatible; Googlebot/2.1; http://www...

Bot "Googlebot/2.1 (+,gzip(gfe) (via"

Bot "Googlebot/2.1 (+"

Bot "GoogleBot/2.1"

Bot "Googlebot/2.1" (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; GTB6.6; SLCC2; .NET CLR 2.0.50727;...

Bot "Googlebot/2.1" (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CL...

Bot "Googlebot/2.1",gzip(gfe) (via

Bot "Googlebot/2.1+(+"

Bot "Googlebot/2.1+(+"

Bot "Googlebot/2.1+(+" Mozilla/5.0 (compatible; Googlebot/2.1; +http://w...

Bot "Googlebot/2.1+(+"Mozilla/5.0 (compatible; Googlebot/2.1; +http://ww...

Bot "Googlebot/2.1+("

Bot " Bot"

Bot "Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +"

Bot "Mozilla/5.0 (compatible; Googlebot/2.1;"

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; +"

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; +" (compatible; MSIE 7.0; Wind...

Bot "Mozilla/5.0 (compatible; Googlebot/2.1; +" (compatible; MSIE 8.0; Wind...

Bot "Mozilla/5.0 (compatible; Googlebot/2.1;"

Bot "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9b4pre) Gecko/2008021019 Fedora/2.0

Bot "Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.go...

Bot ""

Bot "Testbot/1.0 (compatible; Testbot/1.0; +

Bot "Testbot/1.0 (compatible; Testbot/1.0; +"

Bot "YahooFeedSeeker/2.0+(compatible;+Mozilla+4.0;+MSIE+5.5;+"

Bot # UA "Googlebot-Image/1.0"

Bot # UA "Googlebot-Image/1.0"

Bot # UA "Googlebot-Image/1.0"

Bot # UA "Googlebot/Test (+"

Bot # UA "Mozilla/5.0 (compatible; Googlebot/2.1;"

Bot # UA "Mozilla/5.0 (compatible; Googlebot/2.1; +"

Bot # UA Googlebot-Image/1.0 FirePHP/0.3

Bot #1 in Business Networking,

Bot $_agentname

Bot %3Cscript%3Dalert('helo');%3C/script%3D

Bot &

Bot '); select * from user;--

Bot '; DROP TABLE IF EXISTS user,users,members,admin,log,logs,data,post,posts,news --

Bot '; DROP TABLE-- ">'><h1>I made you a cookie, but I eated it :( .</h1>...

Bot 'autokrawl'

Bot 'citeseerxbot'

Bot 'Googlebot/2.1

Bot 'Mediapartners-Google'

Bot ( Robots.txt Validator )

Bot (+

Bot (compatible; Googlebot/2.1; +

Bot (Googlebot-Image/1.0 (+; ; )

Bot (

Bot * Mozilla/5.0 (compatible; Googlebot/2.1; +

Bot */Nutch-0.9

Bot */Nutch-0.9-dev

Bot *Googlebot/2.1+ (+*

Bot +http//


Bot +

Bot +

Bot +

Bot +

Bot +kmem/kernel_memory (Pinto; Turbo EFI) 2300_4-cylinder

Bot (+Have Good Day)

Bot --><script>alert('pwned')


Bot -

Bot ./ libwww-perl/5.805

Bot ./get_title2.cgi/0.1 libwww-perl/5.837

Bot ./pma/0.1 libwww-perl/5.816

Bot .NET Framework Test Client

Bot /usr/bss_miner/user_agents

Bot : Robot/1.0 (linux) (admin e-mail: undefined)

Bot : Robot/1.0 (linux) (admin e-mail: undefined),gzip(gfe) (via translat...

Bot ::_detectURL

Bot :robot/1.0 (linux) ( admin e-mail: undefined )

Bot ;'"><script>window.location=""</sc...

Bot <!--#exec cmd="/bin/id"-->

Bot <!--#exec cmd="ls"-->

Bot <? SELECT * FROM information_schema.tables WHERE information_schema=database() ?>

Bot <?php 'UNION ALL SELECT 1,2,3,4,5' php?>

Bot <?php echo "B" ?>

Bot <?php phpinfo(); ?>

Bot <b> Runnk RSS finder: : Israeli legal : Mishpat : עו&#...

Bot <b>Sawah Bwowser V 1.59 (WinXP)</b>

Bot <body onunload="javascript:alert('Trizen');">

Bot <iframe src="" width="800" height="600&quot...

Bot <iframe src= width=800 height=600>

Bot <img src="javascript:alert('TriZeN')">

Bot <IMG SRC=>

Bot <scblockedript>document.body.innerHTML="<style>body{visibility:hidden;}</sty...

Bot <scblockedript>document.body.innerHTML="<style>body{visibility:hidden;}</sty...

Bot <scblockedript>document.body.innerHTML="<style>body{visibility:hidden;}</sty...

Bot <useragent description="User Agent" useragent="Mozilla/5.0 (compatible; Googlebot/2.1;...

Bot ?<script.error?/?danish? ( - Red Hat)

Bot ?><?php phpinfo(); ?>

Bot ?Mozilla/5.0 (Admin Catalog; Windows NT 5.1;

Bot ?Mozilla/5.0 (compatible; Googlebot/2.1; +

Bot ?script.error?/?danish? ( - Red Hat)

Bot ?Spyder (Mag Reiting:

Bot @="Googlebot/2.1" "Compatible"="+

Bot @="Googlebot/2.1" "Compatible"="+

Bot @=”Googlebot/2.1? (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; Creative AutoUpdate v1.10.10)

Bot @=”Googlebot/2.1? (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; Creative AutoUpdate v1.10.1...

Bot [HKEYLOCALMACHINESOFTWAREMicrosoftWindowsCurrentVersionInternet Settings5.0User agente] @ = "Googlebot/2.1&...

Bot \' exec sp_MSforeachtable "DROP TABLE ? PRINT '? dropped' "

Bot ^Byte (

Bot ^Nail (

Bot _detectURL

Bot {0}{1}VelocityWebshots/3.0 (+

Bot 100k_bot

Bot 100pulse/1.0

Bot 12345 AutoPager/ (

Bot 12345 FirePHP/0.3

Bot 12345 MRA 5.6 (build 03278);

Bot 12345 MRA 5.6 (build 03278); SmartLinksAddon

Bot 123peoplebot/1.0

Bot 123spider-Bot (Version: 1.02, powered by

Bot / Redirect v1.26

Bot 192.comAgent

Bot 1st ZipCommander (Net) -

Bot 20090608_web_ab larbin2.6.3@unspecified.mail

Bot 20090608_web_ac larbin2.6.3@unspecified.mail

Bot 20090608_web_ad larbin2.6.3@unspecified.mail

Bot 20090608_web_aq larbin2.6.3@unspecified.mail

Bot 20090608_web_as larbin2.6.3@unspecified.mail

Bot 20090608_web_bf larbin2.6.3@unspecified.mail

Bot 20090717_aa_page larbin2.6.3@unspecified.mail

Bot 20090717_ab_page larbin2.6.3@unspecified.mail


Bot 360Spider

Bot 4.1.0 Profile

Bot 4.Platz im GIGA-Homepage-Award -


Bot Crawler (

Bot WebBot/0.1 (

Bot LinkChecker v2.0

Bot V0.01 beta ( )

Bot ( + )

Bot -

Bot -

Bot 8484 Boston Project v 1.0

Bot 8bo Crawler Bot

Bot A .NET Web Crawler

Bot A-listed Tablet-emu.view/danish ( - Red Hat)

Bot A-Online Search

Bot “Googlebot/2.1+(+"

Bot “Googlebot/2.1+(+”

Bot “Googlebot/2.1+(+”.

Bot “Googlebot/2.1+(+”

Bot “Googlebot/2.1+(+” Mozilla/5.0 (compatible; Googlebot/2.1; +

Bot ”Mozilla/5.0 Googlebot/2.1 (+

Bot „Googlebot/2.1 (+“

Bot “Googlebot/2.1+(+” Mozilla/5.0 (compatible; Googlebot/2.1; +

Bot A1 Keyword Research/1.0.2 (+ miggibot/2007.03.27

Bot A1 Sitemap Generator/1.4.9 (+ miggibot/2007.07.09

Bot A1 Sitemap Generator/4.0.9 (+ miggibot

Bot A1 Website Download/4.0.4 (+ miggibot

Bot A1 Website Scraper/4.1.4 (+ miggibot

Bot aardvark-crawler

Bot AbachoBOT

Bot AbachoBOT (Mozilla compatible)

Bot abc larbin2.6.3@unspecified.mail

Bot abc/Nutch-0.9-dev (abc;; abc at abc dot com)

Bot ABCdatos BotLink/1.0.2 (test links)

Bot ABCdatos BotLink/

Bot Aberja Checkomat

Bot (;

Bot Abot

Bot abot/0.1 (abot;;

Bot Aboundex/0.2 (

Bot About/0.1libwww-perl/5.47

Bot About/0.1libwww-perl/5.47 

Bot AboutUsBot


Bot AC-BaiduBot/1.1(+

Bot AcadiaUniversityWebCensusClient

Bot Accelatech RSSCrawler/0.4

Bot Accoona-AI-Agent/1.1.1 (crawler at accoona dot com)

Bot Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com)

Bot Ace Explorer

Bot acebookexternalhit/1.0 (

Bot ACME Corporation/Nutch-1.0 (ACME Spider;;

Bot AcoiRobot

Bot Acoon Robot v1.50.001

Bot Acoon Robot v1.52 (

Bot Acoon v4.1.0 (

Bot Acoon v4.10.1 (

Bot Acoon v4.10.3 (

Bot Acoon v4.10.4 (

Bot Acoon v4.10.5 (

Bot Acoon v4.9.3 (

Bot Acoon v4.9.5 (

Bot Acoon-Robot 4.0.0RC2 (

Bot Acoon-Robot 4.0.1 (

Bot Acoon-Robot (

Bot Acoon-Robot v3.xx ( and

Bot AcoonBot/4.10.5 (+

Bot Acorn/Nutch-0.9 (Non-Profit Search Engine;; acorn at isara dot org)

Bot acquia-crawler (detected bad behaviour? please tell us at

Bot AcquiaCrawler

Bot Active Whois 4488

Bot Active9Bot-WebScreenShots-1.0

Bot ActiveWorlds/3.xx (xxx)

Bot Ad Muncher v4.7 Build 27105/1371

Bot Ad Muncher v4.71 Build 28140/1889 [1742]

Bot Ad Muncher v4.72 Build 30400/1967

Bot Ad Muncher v4.72 Build 30400/2235

Bot Ad Muncher v4.81 Build 31376/2807

Bot AdBot 1.0 (

Bot robot

Bot adidxbot/1.1 (+

Bot Adirbot/1.0 (+

Bot AdMedia bot


Bot AdnormCrawler

Bot ADSARobot

Bot AdsBot-Google

Bot AdsBot-Google (+

Bot AdsBot-Google (+ FirePHP/0.5

Bot AdsBot-Google (TEST)

Bot AdsBot-Google-Mobile (+ Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) Ap...

Bot AdsBot-Google-Mobile (Android; +

Bot AdsBot-Google-Mobile (Android; + AppleWebKit

Bot AdsBot-Google-Mobile (Mozilla/5.0 (Linux; U; Android 1.0) AppleWebKit/525.10+ (KHTML, like Gecko) Version/3.0.4 Mobile S...

Bot AdsBot-Google-Mobile (Mozilla/5.0 (Linux; U; Android 1.0) AppleWebKit/525.10+(KHTML, like Gecko) Version/3.0.4 Mobile Sa...

Bot adsense_media_scraper/1.0

Bot AdSenserBot

Bot Advanced URL Catalog 2.x

Bot Aeero SNG v0.2 (+

Bot AEL/ - Anonymous Proxy - We protect fundamental rights (Linux; Intel)

Bot AESOP_com_SpiderMan

Bot Affectv Robot v1.0/Nutch-2.1

Bot africa/Nutch-0.9 (africa; localhost; localhost)

Bot agadine/1.x.x (+

Bot again/1.0

Bot agbot/1.0 ( search engine crawler;;

Bot Agent-SharewarePlazaFileCheckBot/2.0+(+

Bot AgentName/0.1 libwww-perl/5.812

Bot AgentName/0.1 libwww-perl/5.813

Bot AgentName/0.1 libwww-perl/5.831

Bot AgentName/0.1libwww-perl/5.805

Bot AgentName/0.1libwww-perl/5.836

Bot AgentName/0.1libwww-perl/6.02

Bot agentname/Nutch-1.0-dev

Bot Aghaven/Nutch-1.2

Bot Aghaven/Nutch-1.2 (


Bot AHTTPConnection

Bot AIBOT/2.1 By +( , A Real artificial intelligence search engine , China)

Bot AIBOT/2.1 By +( A Real artificial intelligence search engine China)

Bot AideRSS 2.0 (

Bot AideRSS/1.0 (

Bot AideRSS/2.0 (

Bot aipbot/1.0 (aipbot;;

Bot aipbot/2 (aipbot;;

Bot aipbot/2-beta (aipbot dev;;

Bot AISearchBot (Email:; If your web site doesn't want to be crawled, please send us a email.)

Bot AISearchBot (Email:; We love searching and we'll stop crawling immediately depending on your attit...

Bot AJakieToMaZnaczenie/11.2 (compatible; R2D2; C3PO 12-bit; pl-PL) Future/20090507 Jejku/

Bot Aji%20Reader/2.5 CFNetwork/459 Darwin/10.0.0d3

Bot ajSitemap ( )

Bot AKHBOT/1.1 (compatible; MSIE 7.0; Windows NT 6.0)

Bot Akregator/1.2.2; librss/remnants

Bot Akregator/1.2.5; librss/remnants

Bot Akregator/1.2.9; librss/remnants

Bot akv/0.1.0

Bot al_viewer larbin2.6.3@unspecified.mail

Bot alef/0.0

Bot Aleksika Spider/1.0 (+

Bot alert(/xss/)

Bot alexa v0.1.4 (

Bot Alexa Verification Agent

Bot Alexa Verification Client

Bot alexabot_cache

Bot AlexfDownload

Bot AlexionResearchBot/Nutch-1.3

Bot AlienInvaders/1.0 (X11; U; MartianSoftware x86_64; ar-AR; rv:0.0.0) GreenSkin/20121223 Ares/1.00 (mothership) Starship/0...

Bot AlienInvaders/1.0 (X11; U; MartianSoftware xyz_2064; ar-AR; rv:0.0.0) GreenSkin/20121223 mlks/1.00 (mothership) Starship...

Bot AlkalineBOT/1.3

Bot AlkalineBOT/1.4 (1.4.0326.0 RTM)

Bot all_web1 larbin2.6.3@unspecified.mail

Bot all_web2 larbin2.6.3@unspecified.mail

Bot all_web3 larbin2.6.3@unspecified.mail

Bot Allesklar/0.1 libwww-perl/5.46

Bot allizoM

Bot allizoM,gzip(gfe) (via

Bot Allrati/1.1 (+)

Bot AltaVista Intranet V2.0 AVS EVAL

Bot AltaVista Intranet V2.0 AVS EVAL

Bot AltaVista Intranet V2.0 Compaq Altavista Eval

Bot AltaVista Intranet V2.0

Bot AltaVista Intranet V2.0

Bot AltaVista V2.0B

Bot Altresium/4.3 (+

Bot amaya/10.1 libwww/5.4.0

Bot amaya/11.1 libwww/5.4.0

Bot amaya/6.4 libwww/5.3.1

Bot amaya/9.53 libwww/5.4.0

Bot amd-source-bot/Nutch-1.0

Bot Ameblo-Crawler(Mozilla-compatible; )

Bot AmfibiBOT

Bot Amfibibot/0.06 (Amfibi Web Search;;

Bot Amfibibot/0.07 (Amfibi Robot;;

Bot amibot - - libwww-perl/5.805

Bot amibot - - libwww-perl/5.831

Bot AmigaVoyager/2.95 (compatible; MC680x0; AmigaOS; SV1)

Bot Amit Singh/Nutch-0.9 (Amit Singh;;

Bot Amoena Toolkit/1.0

Bot Anemone/0.3.1

Bot Anemone/0.4.0

Bot Anemone/0.5.0

Bot Anemone/0.7.1

Bot AnnoMille spider 0.1 alpha -

Bot Anon/1.0

Bot Anonymous Proxy at (Linux; Intel)

Bot AnoProxy 1.20

Bot Another Python Crawler

Bot AnswerBus (

Bot AnswerChase PROve x.0

Bot AnswerChase x.0

Bot Ant/Ant-Nutch-1.1 (Ant Nutch Crawler;;

Bot AntBot/Ant-Nutch-1.1 (Ant Nutch Crawler;;

Bot Anti-XBOCT/2007 [xxx] (OS; X; JU)

Bot antibot-V1.1.5/i586-linux-2.2

Bot AntiOpensourceBot/1.1 (

Bot AntiOpensourceBot/1.1 ( Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:...

Bot AnzwersCrawl/2.0 (;Engine)

Bot AOL_Daniel_Clark_Spider/Nutch-0.9 (AOL Search;

Bot Apache

Bot Apache mod_qos/9.69 mod_fcgid/2.3.6 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/

Bot Apache-HttpClient/4.0-beta2 (java 1.5)

Bot Apache-HttpClient/4.0.1 (java 1.5)

Bot Apache-HttpClient/4.0.3 (java 1.5)

Bot Apache-HttpClient/4.1 (java 1.5)

Bot Apache-HttpClient/4.1.1 (java 1.5)

Bot Apache-HttpClient/4.1.2 (java 1.5)

Bot Apache-HttpClient/4.1.3 (java 1.5)

Bot Apache-HttpClient/4.2 (java 1.5)

Bot Apache-HttpClient/4.2.1 (java 1.5)

Bot Apache-HttpClient/4.2.2 (java 1.5)

Bot Apache-HttpClient/4.2.3 (java 1.5)

Bot Apache-HttpClient/UNAVAILABLE

Bot Apache-HttpClient/UNAVAILABLE (java 1.4)

Bot (apache;;

Bot Apache/2.2.2 (Windows Server 2008)


Bot Apexoo Spider (

Bot Apexoo Spider 1.0

Bot Apexoo Spider 1.1

Bot Apexoo Spider 1.x

Bot Aplix HTTP/1.0.1

Bot Apostrophe/ (compatible) filecache

Bot AppEngine-Google; (+

Bot AppEngine-Google; (+; 2dgalcz)

Bot AppEngine-Google; (+; appid: alice-bean-01)

Bot AppEngine-Google; (+; appid: bypass-proxy)

Bot AppEngine-Google; (+; appid: cache-001)

Bot AppEngine-Google; (+; appid: cache-012)

Bot AppEngine-Google; (+; appid: calyphrox)

Bot AppEngine-Google; (+; appid: conversion222)

Bot AppEngine-Google; (+; appid: cracksites)

Bot AppEngine-Google; (+; appid: cyberwapdotnet)

Bot AppEngine-Google; (+; appid: deep-diver-sandbox)

Bot AppEngine-Google; (+; appid: domain-worlds)

Bot AppEngine-Google; (+; appid: downforeveryoneorjustme)

Bot AppEngine-Google; (+; appid: faveous)

Bot AppEngine-Google; (+; appid: feediscovery)

Bot AppEngine-Google; (+; appid: fjut-proxy)

Bot AppEngine-Google; (+; appid: fly-proxy)

Bot AppEngine-Google; (+; appid: free4internet)

Bot AppEngine-Google; (+; appid: gasandboxx)

Bot AppEngine-Google; (+; appid: getfavicon)

Bot AppEngine-Google; (+; appid: guckgfw)

Bot AppEngine-Google; (+; appid: ikaryse)

Bot AppEngine-Google; (+; appid: keekle-proxy)

Bot AppEngine-Google; (+; appid: litefeed)

Bot AppEngine-Google; (+; appid: lookingglass-server)

Bot AppEngine-Google; (+; appid: mapthislink)

Bot AppEngine-Google; (+; appid: mobhook)

Bot AppEngine-Google; (+; appid: morrigango)

Bot AppEngine-Google; (+; appid: nation4india)

Bot AppEngine-Google; (+; appid: neceproxy)

Bot AppEngine-Google; (+; appid: nxwkevminus)

Bot AppEngine-Google; (+; appid: okqlba8)

Bot AppEngine-Google; (+; appid: openhippo-proxy-server)

Bot AppEngine-Google; (+; appid: paradigm-web-proxy)

Bot AppEngine-Google; (+; appid: proxy1plus)

Bot AppEngine-Google; (+; appid: proxycode)

Bot AppEngine-Google; (+; appid: proxytea)

Bot AppEngine-Google; (+; appid: pyread)

Bot AppEngine-Google; (+; appid: readability-api)

Bot AppEngine-Google; (+; appid: recomiendar)

Bot AppEngine-Google; (+; appid: retimeme)

Bot AppEngine-Google; (+; appid: retimeme2)

Bot AppEngine-Google; (+; appid: s~app-cruxlight)

Bot AppEngine-Google; (+; appid: s~bookmarksdotio)

Bot AppEngine-Google; (+; appid: s~crawlerwidget)

Bot AppEngine-Google; (+; appid: s~crowdsurfer100)

Bot AppEngine-Google; (+; appid: s~drizzlprox)

Bot AppEngine-Google; (+; appid: s~feedly-social)

Bot AppEngine-Google; (+; appid: s~getfavicon27)

Bot AppEngine-Google; (+; appid: s~gramnacha)

Bot AppEngine-Google; (+; appid: s~jojomalix)

Bot AppEngine-Google; (+; appid: s~kalimiru1984)

Bot AppEngine-Google; (+; appid: s~linksalphacom)

Bot AppEngine-Google; (+; appid: s~liquid-helium)

Bot AppEngine-Google; (+; appid: s~mozaic-api)

Bot AppEngine-Google; (+; appid: s~questionssites)

Bot AppEngine-Google; (+; appid: s~repcore-prod)

Bot AppEngine-Google; (+; appid: s~repcore-test)

Bot AppEngine-Google; (+; appid: s~stackhere)

Bot AppEngine-Google; (+; appid: s~steprep-demo-hrd)

Bot AppEngine-Google; (+; appid: s~steprep-dev-hrd)

Bot AppEngine-Google; (+; appid: s~steprep-hr-test)

Bot AppEngine-Google; (+; appid: s~steprep-prod-hrd)

Bot AppEngine-Google; (+; appid: s~steprep-test-hrd)

Bot AppEngine-Google; (+; appid: s~storeh3398)

Bot AppEngine-Google; (+; appid: s~stremor-crawler)

Bot AppEngine-Google; (+; appid: s~stremor-crawler-dev)

Bot AppEngine-Google; (+; appid: s~stremor-lhe-dev)

Bot AppEngine-Google; (+; appid: s~vikastest111)

Bot AppEngine-Google; (+; appid: s~websitewizardrywebsite)

Bot AppEngine-Google; (+; appid: s~webworldout)

Bot AppEngine-Google; (+; appid: showsiteinf)

Bot AppEngine-Google; (+; appid: showsiteinfo)

Bot AppEngine-Google; (+; appid: shwebproxy)

Bot AppEngine-Google; (+; appid: surf6007)

Bot AppEngine-Google; (+; appid: the-great-escape)

Bot AppEngine-Google; (+; appid: thedomaintips)

Bot AppEngine-Google; (+; appid: tmobile-290815)

Bot AppEngine-Google; (+; appid: trujillosoft-proxy)

Bot AppEngine-Google; (+; appid: urlexpand41)

Bot AppEngine-Google; (+; appid: your-zone)

Bot appie 1.1 (

Bot AppleSyndication/54

Bot AppleSyndication/56.1

Bot Applied-Technologies-Inc-Spider/Nutch-1.4

Bot ArabCoders 3.0 (CLR/

Bot ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4;;)

Bot ArachBot

Bot Arachnoidea (

Bot aranhabot

Bot arch-client/0.1 neon/0.24.0

Bot ArchitextSpider

Bot archive.org_bot

Bot Archlinux Linux3 Mozilla Firefox/3.0

Bot Arexx (AmigaVoyager/2.95; AmigaOS/MC680x0; Mod-X by Pe)

Bot aria2

Bot aria2/1.13.0

Bot aria2/1.15.2

Bot arjun/Nutch-1.4

Bot Arquivo-web-crawler (compatible; heritrix/1.12.1 +

Bot ArteLab WebCrawler

Bot ASAHA Search Engine Turkey V.001 (

Bot Asahina-Antenna/1.x

Bot Asahina-Antenna/1.x ( ;

Bot Aside/ (compatible) filecache

Bot Ask Jeeves/1.0

Bot AskAboutOil/0.06-rcp (Nutch;;

Bot asked/Nutch-0.8 (web crawler;; epicurus at gmail dot com)

Bot ASPSeek/1.2.5

Bot ASPseek/1.2.9d

Bot ASPSeek/1.2.x

Bot ASPSeek/1.2.xa

Bot ASPseek/1.2.xx

Bot ASPSeek/1.2.xxpre

Bot Assonance/ (compatible) filecache

Bot ASSORT/0.10

Bot Asynchronous WinHTTP Demo/1.0

Bot AsyncHttpClient 1.0

Bot Atig::Http/379a1ecdc7925ca768690c0f7d86c57f7bc4b954 (http.rb; net-irc) Ruby/1.9.3 (x86_64-linux)

Bot Atig::Http/5cfeaaebf99e2df40ba4d0bde22124ed87e83b88 (http.rb; net-irc) Ruby/1.8.7 (x86_64-linux)

Bot Atig::Http/b6647d90e8b2f7936a05aae175f644b131b96367 (http.rb; net-irc) Ruby/1.8.7 (x86_64-linux)

Bot Atig::Http/ed0fd0b975055eea562b7ca9b73a1cae9064b13d (http.rb; net-irc) Ruby/1.8.7 (i686-linux)

Bot Atig::Http/unknown (http.rb; net-irc) Ruby/1.8.7 (i386-freebsd6)

Bot atlantic/0.1 (+

Bot atlantic/0.10 (+

Bot atlantic/0.10 (+

Bot atlantic/0.11 (+

Bot atlantic/0.2 (+

Bot atlantic/0.5 (+

Bot atlantic/0.6 (+

Bot atlantic/0.8 (+

Bot atlantic/0.9 (+

Bot AtlasGrid-Bot

Bot AtlocalBot/1.1 +(

Bot Atomic_Email_Hunter/4.0

Bot Atomic_Email_Hunter/4.0 (iPod; U; CPU like Mac OS X; en; ) AppleWebKit/420.1 (KHTML, like Gecko) Version/3.0 Mobile/3A10...

Bot Atomic_Email_Hunter/4.0 (Linux; U; Android 2.2; en-us; Nexus One Build/FRF83) AppleWebKit/533.1 (KHTML, like Gecko) Vers...

Bot Atrax Solutions atraxbot/0.3;

Bot atraxbot/0.2

Bot Attentio/Nutch-0.9-dev (Attentio's beta blog crawler;;

Bot Attributor.comBot

Bot Attributor/Dejan-1.0-dev (Test crawler;; info at attributor com)

Bot Attributor/Nutch-1.0-dev (Test crawler;; info at attributor com)

Bot Audacious/2.4.3 neon/0.28.4

Bot AurNet07

Bot autoemailspider

Bot AutoIt/3.3

Bot AutoItScript/

Bot autokrawl

Bot AutoMapIt Sitemaps - HTTP Status Bot (

Bot AutoMapIt Sitemaps - LinkChecker Bot (

Bot Automattic Analytics Crawler/0.1;

Bot autowebdir 1.1 (

Bot AV Fetch 1.0

Bot AVSearch-1.0(

Bot AVSearch-2.0-fusionIdx-14-CompetitorWebSites

Bot AVSearch-3.0(AltaVista/AVC)

Bot Awahili/7 (

Bot awesomebar_scraper/1.0

Bot awesomebot

Bot aworm-injector/2.00.1a (Red Hat Server-EDT) -

Bot axadine/ (Axadine Crawler;; )

Bot AxmoRobot - Crawling your site for better indexing on search engine.

Bot Axmorobot indexing your site for - World Wide Search Engine from

Bot Axonize-bot

Bot Ayna/Nutch-0.9 (Ayna Search Engine Crawler;; search at aynacorp dot com)

Bot Aynchronous WinHTTP Demo/1.0

Bot Azureus/4306

Bot baa [the_sheep]

Bot BabalooSpider/1.3 (BabalooSpider;;

Bot BaboomBot/1.[0-255].[0-255] (\+

Bot BaboomBot/1.x.x (+

Bot Backlink Crawler v1.0

Bot BacklinkCrawler (

Bot BacklinkCrawler V (

Bot`s crawler v.2

Bot baidu bot6483052

Bot baidu/Nutch-1.0

Bot BaiduImagespider+(+

Bot Baiduspider

Bot Baiduspider (+

Bot BaiduSpider+ (+;; Ubuntu; Compatible; Version; Platform; .NET CLR 2.0.50727; Vers...

Bot Baiduspider+ (+; MSIE 7.0; Windows NT 6.0; Mozilla/4.0 (compatible; MSIE 6.0; ...

Bot Baiduspider+(+baidu/search/spider.htm:baidu/search/spider.htm)

Bot Baiduspider+(+

Bot Baiduspider+(+

Bot Baiduspider+(+

Bot Baiduspider+(+

Bot Baiduspider+(+

Bot Baiduspider+(

Bot Baiduspider-cpro

Bot Baiduspider-favo+(+

Bot Baiduspider-image+(+

Bot baiduspider-mobile-gate

Bot Balihoo/Nutch-1.0-dev (Crawler for search engine - obeys robots.txt and robots meta tags ;

Bot Barca/2.0.xxxx

Bot BarraHomeCrawler (

Bot Basalt v090b

Bot BatchScan

Bot baypup/1.1 (Baypup;;

Bot baypup/colbert (Baypup;;

Bot baypup/colbert (Baypup;;

Bot bCentral Billing Post-Process

Bot bdcindexer_2.6.2 (research@bdc)

Bot BDFetch

Bot BDNcentral Crawler v2.3 [en] ( (X11; I; Linux 2.0.44 i686)

Bot BDNcentral Crawler v2.3 [en] ( (X11; I; Linux 2.0.44 i686),gzip(gfe) (via translate...

Bot BeamMachine/0.5 (dead link remover of

Bot beast/Nutch-0.9 (agentspider;

Bot beautybot/1.0 (+

Bot BebopBot/2.5.1 ( crawler )

Bot BeckyBot/2.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)

Bot becomex /Google-11.0

Bot becomex /Nutch-0.9

Bot becomex /Nutch-1.0

Bot beetel UNTRUSTED/1.0

Bot Begun Robot Crawler

Bot Begun Robot Crawler (TESTING)

Bot bender/Nutch-0.8.1 (

Bot bensbot

Bot betaBot

Bot BGSY bot/1.0

Bot BigCliqueBOT/1.03-dev (bigclicbot;;

Bot BIGLOTRON (Beta 2;GNU/Linux)

Bot Biglotron-3.01 larbin2.6.3@unspecified.mail

Bot Biglotron-3.01

Bot ( Internet Spider;;

Bot ( Internet Spider;;

Bot ( Internet Spider;;

Bot BilgiBetaBot/0.8-dev ( (Beta) ;;

Bot BilgiBot/1.0(beta) (; bilgi at bilgi dot com)

Bot bim-zone (+

Bot Bimbot/1.0

Bot bing/1.0

Bot bingbot/2.0; +

Bot Bingbot/3.3 (Commodore; N; M$IE 8.0; Android 1.2.22; rv:13.1) Presto/20130510 Arora/17.4.5 Spamdog/5.3.4

Bot bingbot/3.3 (Windows; I; MSIE 8.0; Darwin 2.4.10; XC68000; rv:10.1) Gecko/20020320 Chrome/8.1.5 Seabird/19.4.3

Bot Bingbot/4.3 (Amiga; U; M$IE 8.0; MULTICS 3.2.26; z/90; rv:3.2) Lizard/20031222 Fennec/7.5.3 Skyfly/4.5.4

Bot Bingbot/4.8 (compatible; I; MSIE 7.0; HP-UX 1.2.27; TS6800; Trident/6.3) Dragon/20100811 Chrome/18.5.6 Turboweasel/9.0.9

Bot bingbot/5.7 (Motif; MSIE 12.0; Encom OS 3.2.19; 80386; rv:14.5) Gangsta/20000220 Mobile/17.4.2 Opera/2.7.6

Bot bingbot/6.3 (LCARS; I; M$IE 8.0; DDoS 3.1.6; R6500; Trident/1.5) AppleWebkit/20150900 Chrome/1.2.0 Firedog/15.0.2

Bot BinGet/1.00.A (

Bot BingSearch/1.0.0 CFNetwork/459 Darwin/10.0.0d3

Bot binlar_2.6.3 binlar2.6.3@unspecified.mail

Bot binlar_2.6.3 test@mgmt.mic

Bot Bitacle bot/1.1

Bot Bitacle Robot (V:1.0;) (

Bot bitlybot

Bot bitlybot/2.0

Bot bitmagicbot/0.1

Bot BitTorrent/3.4.2

Bot BitvoUserAgent (+ Bitvo/0.9b

Bot Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx)

Bot Biz360 spider (;

Bot BKA WebSiteChecker/0.98-20080419

Bot BKAspider/1.0 (+

Bot blackcrawl/Nutch-0.9 (crawl for fun;; zipfelchappe@localhost)

Bot blackspider

Bot Blaiz-Bee/1.0 (+

Bot Blaiz-Bee/2.00.5502 (+

Bot Blaiz-Bee/2.00.5622 (+

Bot Blaiz-Bee/2.00.5655 (+

Bot Blaiz-Bee/2.00.8222 (BE Internet Search Engine

Bot Blaiz-Bee/2.00.8315 (BE Internet Search Engine

Bot Blaiz-Bee/2.00.xxxx (+

Bot bldbCrawler/Nutch-1.4

Bot bleeding-sucker-bot (+

Bot Spider (research purposes only)/Nutch-1.2 (This spider intends to collect individual webpages (no...

Bot Blern 1.4

Bot blind-dice


Bot (Mozilla compatible)

Bot Blog Conversation Project;;

Bot BlogBot/1.x

Bot BlogBridge 3.0.1 Discoverer (

Bot BlogBridge 4.0 Discoverer ( Java/1.5.0_03

Bot BlogBridge Service ( Java/1.5.0_09

Bot BlogCorpusCrawler 1.414213 <>

Bot Bloglines Title Fetch/1.0 (

Bot Bloglines/2.1 (; xx subscribers)

Bot Bloglines/2.1 (;xx subscribers)

Bot Bloglines/3.1 (

Bot Blogpulse (

Bot BlogPulseLive (

Bot BlogRangerCrawler/1.0

Bot BlogSearch/1.0 +

Bot BlogSearch/1.x +

Bot blogsearchbot-pumpkin-2

Bot blogsearchbot-pumpkin-3

Bot BlogsNowBot, V 2.01 (+

Bot BlogVibeBot-v1.1 (

Bot BlogzIce/1.0 (+;

Bot BlogzIce/1.0 +

Bot BloobyBot

Bot Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ;

Bot Blubberlutsch/1.0

Bot BlueCrab/4.9.5 (Macintosh; U; PPC Mac OS X; en)

Bot BlueDragon

Bot blynx/1.0 (Lynx/1.0; HP/SUX)

Bot BM-WebExplorer-DLL/v1.1h


Bot BND WebSiteChecker/0.95-20080408

Bot bnyonkqwyagacpbyfhwft

Bot bob/Nutch-0.9 (bob;; x@y)

Bot BobCrawl/Nutch-0.9 (Test/Development crawler;;

Bot ( )

Bot ( )

Bot ( )

Bot ( )

Bot (


Bot (

Bot Bombtech/0.1-alpha (

Bot BOneB Spider

Bot boo/Nutch-1.0

Bot boo/Nutch-1.0 (boo)

Bot Bookdog/4.3.0

Bot Bookdog/5.1.12

Bot Bookdog/5.1.36

Bot Bookdog/5.1.44

Bot Bookdog/5.2

Bot Bookdog/5.3.10

Bot Bookdog/5.3.13

Bot Bookdog/5.3.15

Bot Bookdog/5.3.3

Bot Bookdog/5.3.6

Bot Bookdog/5.3.8

Bot BookishBot

Bot BookMacster/1.0.5

Bot BookMacster/1.2.6

Bot BookMacster/1.3.1

Bot BookMacster/1.3.10

Bot BookMacster/1.3.14

Bot BookMacster/1.3.17

Bot BookMacster/1.3.9

Bot Bookmark Buddy bookmark checker (

Bot BookmarkSync/2.3.2(Windows; U; Microsoft Windows NT 5.1.2600 Service Pack 2; en-US;)

Bot BookmarkSync/2.3.2(Windows; U; Microsoft Windows NT 5.1.2600 Service Pack 3; en-US;)

Bot boosker/Nutch-1.2

Bot Booster/1.0

Bot bot

Bot Bot ">'><script>alert(123)</script> FirePHP/0.3

Bot bot (Java Hotspot(TM) Server 64-Bit VM; + Resource Description Engine

Bot Bot Apoena 2.0;

Bot Bot AutoMapIt Sitemaps - HTTP Status Bot (

Bot Bot DoCoMo/2.0 P906i(c100;TB;W24H15) (compatible; MSNBOT-MOBILE/1.1;+

Bot Bot Godzilla/9.0 (iPad; I; IRIX 2.2.3; 80186; rv1.2.8) KHTML/20120101 Windspider/3.0.13

Bot Bot

Bot Bot Mozilla/5.0 (compatible: Googlebot/2.1: +http//

Bot Bot Opera/9.80 (J2ME/MIDP; Opera Mini/4.6 (Linux x86_64; Android; N; en-US) (Version: 1.02, powered by

Bot (+

Bot Bot-Seeker/1.0 (Bot-Seeker)


Bot (+

Bot BOT/0.1 (BOT for JCE)

Bot bot/1.0

Bot bot/1.0 (bot; http://;

Bot bot/1.0 (bot;;

Bot (+

Bot botbot 14.1.3

Bot BotBuster/2.0 (compatible; MSIE 6.0; Windows NT 5.1)

Bot BotBuster/2.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 3.0.04506.30)

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BotTracer; (+ visited

Bot BoX 64 (NVidea GForce 4 Architecture); +

Bot BPImageWalker

Bot BPImageWalker/2.0 (

Bot Brand New Crawler

Bot BravoBrian SpiderEngine MarcoPolo

Bot BREW-Applet/0x0606060E (BREW/; DeviceId: 2501; Lang: en)

Bot BREW-Applet/0x20068888 (BREW/; DeviceId: 180041; Lang: zhcn) ucweb-squid

Bot BREW-Applet/0x20068888 (BREW/; DeviceId: 40144; Lang: zhcn) ucweb-squid

Bot BREW-Applet/0x20068888 (BREW/; DeviceId: 600; Lang: zhcn) ucweb-squid

Bot BrightCrawler (

Bot BrightCrawler 1.0 (;

Bot BruinBot (+

Bot Brutezilla/X.O (unisystem X.O; rv:X.O) hiccup/10100101 open/X.O

Bot BSDSeek/1.0

Bot BTbot/0.x (+

Bot BubbleGum/4.0

Bot BufferBot

Bot BuildCMS crawler (

Bot Bundestrojaner_1.5

Bot BurstFindCrawler/1.1 (;;

Bot Buscaplus Robi/1.0 (

Bot businessdbbot/v1.2 (

Bot Busiversebot/v1.0 (

Bot BuzzSoRadBot/0.1 (

Bot bwh3_user_agent

Bot bwh3_user_agent (compatible; MSIE 7.0; Windows NT 6.0) FirePHP/0.1.2

Bot bwh3_user_agent FirePHP/0.1.2

Bot bwh3_user_agent FirePHP/0.4

Bot bzr/2.1.0 (urllib)


Bot CaBot

Bot Cabot/Nutch-0.9 (Amfibi's web-crawling robot;;

Bot Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot;;

Bot Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot;; help at amfibi dot com)

Bot Cabot/Nutch-1.2 (Amfibi's webcrawler robot;;

Bot CacheServer

Bot caizhi/infomation/Nutch-0.8.1

Bot CakePHP

Bot Caliperbot/1.0 (+

Bot CamelHttpStream/1.0

Bot CamontSpider/1.0 +

Bot cancho/Nutch-1.0 (crawl test;;

Bot Canookle/1.1 (+

Bot Carnegie_Mellon_University_Research_WebBOT-->PLEASE READ-->

Bot Carnegie_Mellon_University_WebCrawler

Bot Carracas 1.4.1

Bot Casper Bot Search

Bot Castabot/0.1 (+

Bot Catall Spider

Bot CatchBot/1.0; +

Bot CatchBot/2.0; +

Bot CatchBot/3.0; +

Bot Catharsis/ (compatible) filecache

Bot Cazoodle/Nutch-0.9-dev

Bot Cazoodle/Nutch-0.9-dev (Cazoodle Nutch Crawler;;

Bot CazoodleBot/0.0.2 (;

Bot CazoodleBot/0.0.2 (;

Bot CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler;;

Bot CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler;;

Bot CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler;;

Bot CC-rget/5.818 libwww-perl/5.805

Bot CC-rget/5.818 libwww-perl/5.813

Bot CC-rget/5.818 libwww-perl/5.823

Bot CC-rget/5.818 libwww-perl/5.831

Bot CC-rget/5.818 libwww-perl/5.834

Bot CC-rget/5.818 libwww-perl/5.837

Bot CC-rget/5.818 libwww-perl/6.02

Bot CCBot/1.0 (+

Bot ccnurl bot 1.0 (

Bot ccubee/2008

Bot ccubee/3.5

Bot CentiverseBot - investigator

Bot CentiverseBot - investigator/3.0 (

Bot CERN/3.0 libwww/2.17


Bot cf_crawler/0.1 libwww-perl/5.808

Bot cfetch/1.0


Bot cfnetwork

Bot CFNetwork/1.1

Bot CFNetwork/10.4.3

Bot CFNetwork/129.13

Bot CFNetwork/129.16

Bot CFNetwork/129.18

Bot CFNetwork/129.19

Bot CFNetwork/129.20

Bot CFNetwork/129.21

Bot CFNetwork/129.22

Bot CFNetwork/152.4

Bot CFNetwork/217

Bot CFNetwork/220

Bot CFNetwork/221.5

Bot CFNetwork/330

Bot CFNetwork/330.4;afcid=M1b8c4d35092ddb4ebe51f30bfeb6c5fa

Bot CFNetwork/4.0

Bot Charlotte

Bot Chat Catcher - (

Bot Check%20asp/1 CFNetwork/596.2.3 Darwin/12.2.0 (x86_64) (VMware7%2C1)

Bot check_http/1.81 (nagios-plugins 1.4)

Bot Checkbot/1.xx LWP/5.xx

Bot robot

Bot CheckHost (

Bot Checklinks/1.3 (pywikipedia robot;

Bot CheckUrl

Bot CHeeseboT

Bot Chen Li/Nutch-1.0 (Nutch spiderman;;

Bot Cherchebot/1.0 (+

Bot CheshireCheck/1.0 libwww-perl/5.808

Bot Chickety China (the Chinese Chicken)

Bot Chickety China (the Chinese Chicken) / Nutch-0.9

Bot Chilkat/1.0.0 (+

Bot Chirplinks/1.0

Bot chirplinks_res/1.0

Bot Chirrup/1.130

Bot Chitika ContentHit 1.0

Bot Chitika-Linx/1.0 (+

Bot ChitikaBot/1.1 (+

Bot ChristCRAWLER 2.0

Bot CHttpClient by Open Text Corporation

Bot Chuck+Googlebot/2.1 ;+

Bot chWWW/0.3 +http://

Bot chWWW/0.4 +http://

Bot chWWW/0.5 +http://

Bot CIA Crawl Robot/2.3 (Windows; U; Windows NT 3.1; en-US; rv:2.0)

Bot CIA/2.3 (KrazyGlue/Atari2600; Windows; U; Windows NT 6.0; en-US; rv:2.0; gecko/20081217 FBI_Server_Redirect (.N...

Bot Ciao/9.25 (Windows NT 6.0; U; en)

Bot cierzo-development/Nutch-1.1-dev

Bot CIPAV/12.1 (+

Bot CipinetBot (

Bot;Mozilla/5.0;MSIE 7.0;++

Bot Cityreview Robot (+

Bot CJNetworkQuality;

Bot CjxSearch/Nutch-1.4

Bot ClamAV 0.92

Bot ClamAV 0.95.2

Bot Clambot 0.1a

Bot ClariaBot/1.0

Bot Clickthink/CT-3.1

Bot CligooRobot/1.0

Bot CloakDetect/0.9 (+

Bot CloudACL/Nutch-1.4

Bot Clown Epoch

Bot Clushbot/2.x (+

Bot Clushbot/3.x-BinaryFury (+

Bot Clushbot/3.xx-Ajax (+

Bot Clushbot/3.xx-Hector (+

Bot Clushbot/3.xx-Peleus (+

Bot Cluuz/0.91

Bot CMS Identify Crawler/2.0

Bot CMS Survey

Bot cms4site browser/3.0 (MSIE incompatible)

Bot cn_3 larbin2.6.3@unspecified.mail

Bot cn_com_viewer larbin2.6.3@unspecified.mail

Bot cn_web_viewer_web larbin2.6.3@unspecified.mail

Bot CoBITSProbe

Bot Cobra

Bot CobWeb/1.0 (auto classifier)

Bot coccoc

Bot coccoc/1.0 ()

Bot coccoc/1.0 (

Bot coccoc/1.0 (

Bot coccoc/1.0 ( AppEngine-Google; (+; appid: s~doingfly)

Bot Code/1.2 CFNetwork/485.13.9 Darwin/11.0.0

Bot (coder news search engine -

Bot Coderz-Bot (

Bot CodeViewer%202/507 CFNetwork/485.13.9 Darwin/11.0.0

Bot CoffeeCup Software's Catalyst Framework: Request Class

Bot Cogentbot/1.X (+

Bot ColdFusion

Bot Colloquy4132 CFNetwork/438.12 Darwin/9.7.0 (i386) (MacBookPro1%2C1)

Bot com_viewer larbin2.6.3@unspecified.mail

Bot com_web larbin2.6.3@unspecified.mail

Bot com_web_viewer larbin2.6.3@unspecified.mail

Bot com_web1 larbin2.6.3@unspecified.mail

Bot Combine/3

Bot Combine/x.0

Bot cometrics-bot,

Bot Community Server 2.1.60809.935 (Microsoft Windows NT 5.2.3790 Service Pack 1; .NET CLR 2.0.50727.42;)

Bot Comodo-Certificates-Spider

Bot COMODOSpider(+

Bot COMODOspider/Nutch-1.0

Bot COMODOSpider/Nutch-1.2

Bot compatible; Googlebot/2.1 (+; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Me...

Bot compatible; Googlebot/2.1; +

Bot compatible; Mozilla 4.0; MSIE 5.5; (SqwidgeBot b0.6.2 -

Bot compatible; Mozilla 4.0; MSIE 5.5; (SqwidgeBot b1 -

Bot compatible;+Googlebot/2.1;++

Bot complex_network_group/Nutch-0.9-dev (discovering the structure of the world-wide-web;

Bot Computer_and_Automation_Research_Institute_Crawler

Bot computergeektipsbot/0.02b (; U; ; 2047-7; en)

Bot Comrite/0.7.1 (Nutch;;


Bot con2txt/1.0

Bot Connotea libwww-perl/5.808

Bot Connotea libwww-perl/5.837

Bot conpilot crawler (

Bot ContactBot/0.2

Bot Content Crawler

Bot Content Crawler Spider

Bot ContentBarrier%20X510.5.4%20 CFNetwork/422.15.2 Darwin/9.6.0 (i386) (MacPro1%2C1)

Bot Convera Internet Spider V6.x

Bot ConveraCrawler/0.2

Bot ConveraCrawler/0.7 (+

Bot ConveraCrawler/0.8 (+

Bot ConveraCrawler/0.9 (+

Bot ConveraCrawler/0.9d (+

Bot ConveraCrawler/0.9e (+

Bot ConveraCrawler/0.9e (+

Bot ConveraMultiMediaCrawler/0.1 (+

Bot Cookie%20Stumbler/1450 CFNetwork/454.12.4 Darwin/10.8.0 (i386) (MacBookPro5%2C2)

Bot CookieMonster

Bot CoolBot

Bot CoolBot/1.0

Bot copyright sheriff (

Bot copyright sheriff (+

Bot CopyRightCheck

Bot CoralWebPrx/0.1.19 (See

Bot CoralWebPrx/0.1.20 (See

Bot core-project/1.0

Bot CorenSearchBot/1.0 libwww-perl/5.807

Bot CorenSearchBot/1.0 libwww-perl/5.808

Bot CorenSearchBot/1.4 en libwww-perl/5.808

Bot CorenSearchBot/1.5 en libwww-perl/5.834

Bot CorenSearchBot/1.5 en libwww-perl/6.02

Bot CorenSearchBot/1.7 en libwww-perl/5.834

Bot CorenSearchBot/1.7 en libwww-perl/6.04

Bot coruscan/Nutch-1.4

Bot cosmos/0.8_(

Bot cosmos/0.9_(

Bot Covac TexAs Arachbot

Bot Covario Amazon Nutch Crawler/Nutch-1.2

Bot Covario IDS/Nutch-1.2

Bot Covario-IDS/1.0 (Covario;; support at covario dot com)

Bot Covario-IDS/1.0 (Covario;; support at covario dot com)

Bot Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 /

Bot Cowbot-0.1.x (NHN Corp. / +82-2-3011-1954 /

Bot CowCrawler/CowCrawler-dev (+

Bot cpu_pesquisa (compatible; heritrix/1.12.1 +;

Bot [en] (Windows 3.1; I) [Netscape]

Bot Cracka Killa Bot

Bot crawl test/Nutch-1.0-dev


Bot CRAWL-E/0.5

Bot CRAWL-E/0.6.2

Bot CRAWL-E/0.6.4

Bot crawl/0.4 libcrawl/0.3

Bot CrawlConvera0.1 (

Bot Crawler

Bot Crawler (

Bot Crawler 1.0

Bot Crawler

Bot Crawler for Netopian (

Bot Crawler for Sika Solutions (

Bot crawler root@localhost

Bot Crawler V 0.2.x

Bot Crawler.MyCrawler

Bot Crawler/1.0

Bot Crawler/1.0+