Bots vs Browsers : Public Bot / User Agent Database & Commentary

Bots vs Browsers - Public Bot / User Agent Database & Commentary


Home | Archives | About User Agents | User Agent Test Track | Recent Additions | Contributors | Donate | Top Searches | User Agent IP Directory

Bots vs Browsers - database of 875,176 user agents and growing




2006.7.25 - 40,000 User Agents!!!

Today, Bots vs Browsers finally broke the big 40,000 user agent benchmark. In the last few weeks leading up to this, we have seen quite a few new bots also (18 to be exact). The most eventful visits were:
  • Gaisbot/3.0 paid us a visit, apparently from university affiliated with Global Area Information Servers.
    They were also kind enough to disclose a URL and an email address in the user agent string, in case anyone has questions / complaints.   related...
  • The Bloglines/3.1 bot came by to read up on our blog.   related...
  • MyFamilyBot/1.0 appeared in our web logs also, apparently looking for family-related content.   related...
  • Crawler/1.0 made it's debut sporting a very creative and original name. Crawler/1.0 comes from the land of http://elibron.com (which is ironically a literature site, yet names are scarce...)   related...
  • PediaSearch.com Crawler crawled by - I can't seem to find any information about this user agent, but I'd say it's safe to assume it's a crawler.   related...
  • MQBot visited our sites also - this is a bot that aids in research and development at the University of Illinois in Urbana-Champaign.   related...
  • The yoono/1.0 web-crawler/1.0 (pronunciation anyone?) web crawler stopped by as well.   related...
  • Both Yahoo! Slurp and Googlebot stepped up with new bots on our sites in the last three weeks.   related...
  • MojeekBot/2.0 crawled by looking for content for it's search engine at Mojeek.com.   related...
  • And, as always, a few new iterations of FindLinks came over. Development efforts over at the FindLinks laboratories must be very fruitful, seeing that versions 1.1.3-beta2, 1.1.3-beta3, and 1.1.3-beta4 have all been introduced this month.
    To see a history of FindLinks bots that have toured our sites, click here   related...
The latest catch puts our database at 40,000 user agents and 436 bots

Blog Archives:

2010.1.12

Happy 4th Birthday, Bots vs Browsers!
2009.7.12

300,000 User Agents!
2009.5.31

Summer Bots make a splash!
2009.4.18

Where did Palm go?
2009.2.18

Happy Belated 3rd Birthday to Us!
2008.11.23

Bots should be thankful
2008.10.22

Would you say I have a plethora of new bots?
2008.9.6

200,000 User Agents!
2008.8.3

Here comes August...
2008.7.13

2,000 bots!
2008.7.6

Dog Days of Summer Bots
2008.6.23

Another one bites the dust
2008.6.22

Bots don't run out of gas
2008.6.19

And we're back...
2008.1.21

Happy 2nd Birthday!
2007.10.25

The Creature Post
2007.9.7

iTunes, Facebook, Google Earth, and more
2007.7.22

Hot Summer Bots
2007.7.6

The Apple iPhones have landed!
2007.6.13

Twiceler calls off the bots
2007.6.13

Twiceler Strikes!
2007.6.3

Land of 1,000 bots
2007.4.22

April Bots Bring May Traffic... (we hope)
2007.4.16

Spring Cleaning in the Web Traffic Logs
2007.3.24

March Bot Madness
2007.3.10

Got Spiders?
2007.2.24

Some New Faces (bots, of course)
2007.2.10

Winks, DataFountains, Hijacks, and Tool - what's the connection?
2007.2.3

February Stars
2007.1.12

Happy 1st Birthday!
2007.1.1

The 2007 bots are in!
2006.12.23

Have a Merry-Bot-Christmas
2006.12.12

50,000 User Agents!
2006.11.4

2 weeks, 19 new bots
2006.10.17

2 weeks, 30 bots
2006.10.2

4 weeks, 23 bots
2006.9.9

Playing catchup with the bots
2006.8.26

500 bots!
2006.8.20

5 days, 8 bots
2006.8.15

Two weeks, 15 new bots
2006.8.2

Another week, another gang of new bots
2006.7.25

40,000 User Agents!!!
2006.7.4

New category, bot revisions, and 6 new bots for July 4th
2006.6.25

New batch of imports!
2006.6.18

5 new bots, just in time for Father's Day!
2006.6.4

8 new bots for the database
2006.5.19

A couple new sightings
2006.5.9

Quiet week, one new bot
2006.5.2

A few new bots
2006.4.20

A quick bot-sighting update
2006.4.12

More user agents, more bots
2006.3.19

5,000+ New User Agents
2006.3.9

42 more bots, lots of new user agents
2006.2.19

New Bots and Browsers just addded!
2006.1.25

Welcome to Bots vs Browsers!
2006.1.17

Welcome to the User Agents Database that has no name yet!
2006.1.12

Day One