Bots vs Browsers : Public Bot / User Agent Database & Commentary

Home | Archives | About User Agents | User Agent Test Track | Recent Additions | User Agent Contributors | Webmaster Headlines | User Agent IP Directory

Bots vs Browsers - database of 186,339 user agents and growing

2006.8.20 - 5 days, 8 bots

In the brief 120 hours since my last post, we've encountered 8 new bots. At this rate, to make sure we don't get behind, here's the news on these new bots:
  • A new version of TurnitinBot/2.0 came by. According to their site, Turnitin indexes content on the web to compare to student's school work, to try and detect plagiarism. We are flattered that this bot felt the need to crawl our site, and would be even more flattered if a student ever plagiarized our content.   related...
  • In other news, WeRelateBot/0.9 searched our site for content related to ancestry. WeRelate.org owns this bot, and their site allows you to discover information about your family's history. It really is a smart move to crawl a website about bots to harvest content about human ancestry...   related...
  • Startup search engine "Sproose" sent a new crawler by, sproose/0.1. According to the Sproose home page, their "personalized search" technology is still in the works, so keep an eye out for this new service to launch.   related...
  • NimbleCrawler dropped in a new version this week, debuting NimbleCrawler 2.0.1.   related...
  • MSN showed up to the party with a new MSN Bot, msnbot-Products/1.0.   related...
  • Never seen this one before... Mozilla/5.0 crawl@digigetx.com Safe to say it's a bot from the "crawl" part of the User Agent. For more information, drop them a line at crawl@digigetx.com - they didn't include their email for nothing.   related...
  • Microsoft Research sent it's bot by, MSRBOT, for a look around our sites.   related...
  • And finally, our weekly findlinks version iteration came by like clockwork this week, now reporting version findlinks/1.1.3-beta8.   related...
The week concludes, putting our database at 41,818 user agents and 492 bots

Archives:

2008.7.6

Dog Days of Summer Bots
2008.6.23

Another one bites the dust
2008.6.22

Bots don't run out of gas
2008.6.19

And we're back...
2008.1.21

Happy 2nd Birthday!
2007.10.25

The Creature Post
2007.9.7

iTunes, Facebook, Google Earth, and more
2007.7.22

Hot Summer Bots
2007.7.6

The Apple iPhones have landed!
2007.6.13

Twiceler calls off the bots
2007.6.13

Twiceler Strikes!
2007.6.3

Land of 1,000 bots
2007.4.22

April Bots Bring May Traffic... (we hope)
2007.4.16

Spring Cleaning in the Web Traffic Logs
2007.3.24

March Bot Madness
2007.3.10

Got Spiders?
2007.2.24

Some New Faces (bots, of course)
2007.2.10

Winks, DataFountains, Hijacks, and Tool - what's the connection?
2007.2.3

February Stars
2007.1.12

Happy 1st Birthday!
2007.1.1

The 2007 bots are in!
2006.12.23

Have a Merry-Bot-Christmas
2006.12.12

50,000 User Agents!
2006.11.4

2 weeks, 19 new bots
2006.10.17

2 weeks, 30 bots
2006.10.2

4 weeks, 23 bots
2006.9.9

Playing catchup with the bots
2006.8.26

500 bots!
2006.8.20

5 days, 8 bots
2006.8.15

Two weeks, 15 new bots
2006.8.2

Another week, another gang of new bots
2006.7.25

40,000 User Agents!!!
2006.7.4

New category, bot revisions, and 6 new bots for July 4th
2006.6.25

New batch of imports!
2006.6.18

5 new bots, just in time for Father's Day!
2006.6.4

8 new bots for the database
2006.5.19

A couple new sightings
2006.5.9

Quiet week, one new bot
2006.5.2

A few new bots
2006.4.20

A quick bot-sighting update
2006.4.12

More user agents, more bots
2006.3.19

5,000+ New User Agents
2006.3.9

42 more bots, lots of new user agents
2006.2.19

New Bots and Browsers just addded!
2006.1.25

Welcome to Bots vs Browsers!
2006.1.17

Welcome to the User Agents Database that has no name yet!
2006.1.12

Day One




Supported by Aptitude Technology Limited