Bots vs Browsers : Public Bot / User Agent Database & Commentary

Home | Archives | About User Agents | User Agent Test Track | Recent Additions | User Agent Contributors | Webmaster Headlines | User Agent IP Directory

Bots vs Browsers - database of 185,406 user agents and growing

2006.12.12 - 50,000 User Agents!

This month we spent putting a new backend on the site, as well as migrating to a new server.
In the meantime, we were visited by 39 new bots, so here's some quick catchup.
Oh, by the way, we also passed the 50,000 user agent milestone this month - hurray!
  • GurujiBot/1.0 stopped by, and in following their URL in the user agent, I found out that "GurujiBot is the user-agent for Guruji's web crawler. Guruji is crawling the web to build a Next Generation Search Engine.". According to their site, they obey the robots.txt exclusion standard. related...
  • Blog Conversation Project has been reading up on our sites working on a project for Harvard. According to their site, "The Blog Conversation Project is a research study seeking to develop methods of automatically reading and coding a large sample of blogs so that we might be able to measure the views expressed in this national or international conversation." The URL they provide is an interesting read and has more information about their project, so you should follow it and read more about them. related...
  • lanshanbot/1.0 passed by and included the MSN bot URL for their own. Upon following their URL, there is no mention of lanshanbot, so we are not sure if they are posing or legit. related...
  • Sunrise/0.42i hit our logs - this agent is used by an open source project called "Sunrise" that "converts websites and newsfeeds for offline reading on your handheld". related...
  • Straight from Hungaria, the LapozzBot/1.4 has been poking around our sites this month. They also have a website, but none of us read hungarian, so we'll leave it up to you to read up on their intentions. related...
This month leaves us at 50,350 user agents and 641 bots

Archives:

2008.6.23

Another one bites the dust
2008.6.22

Bots don't run out of gas
2008.6.19

And we're back...
2008.1.21

Happy 2nd Birthday!
2007.10.25

The Creature Post
2007.9.7

iTunes, Facebook, Google Earth, and more
2007.7.22

Hot Summer Bots
2007.7.6

The Apple iPhones have landed!
2007.6.13

Twiceler calls off the bots
2007.6.13

Twiceler Strikes!
2007.6.3

Land of 1,000 bots
2007.4.22

April Bots Bring May Traffic... (we hope)
2007.4.16

Spring Cleaning in the Web Traffic Logs
2007.3.24

March Bot Madness
2007.3.10

Got Spiders?
2007.2.24

Some New Faces (bots, of course)
2007.2.10

Winks, DataFountains, Hijacks, and Tool - what's the connection?
2007.2.3

February Stars
2007.1.12

Happy 1st Birthday!
2007.1.1

The 2007 bots are in!
2006.12.23

Have a Merry-Bot-Christmas
2006.12.12

50,000 User Agents!
2006.11.4

2 weeks, 19 new bots
2006.10.17

2 weeks, 30 bots
2006.10.2

4 weeks, 23 bots
2006.9.9

Playing catchup with the bots
2006.8.26

500 bots!
2006.8.20

5 days, 8 bots
2006.8.15

Two weeks, 15 new bots
2006.8.2

Another week, another gang of new bots
2006.7.25

40,000 User Agents!!!
2006.7.4

New category, bot revisions, and 6 new bots for July 4th
2006.6.25

New batch of imports!
2006.6.18

5 new bots, just in time for Father's Day!
2006.6.4

8 new bots for the database
2006.5.19

A couple new sightings
2006.5.9

Quiet week, one new bot
2006.5.2

A few new bots
2006.4.20

A quick bot-sighting update
2006.4.12

More user agents, more bots
2006.3.19

5,000+ New User Agents
2006.3.9

42 more bots, lots of new user agents
2006.2.19

New Bots and Browsers just addded!
2006.1.25

Welcome to Bots vs Browsers!
2006.1.17

Welcome to the User Agents Database that has no name yet!
2006.1.12

Day One




Supported by Aptitude Technology Limited