Bots vs Browsers : Public Bot / User Agent Database & Commentary

Home | Archives | About User Agents | User Agent Test Track | Recent Additions | User Agent Contributors | Top Searches | User Agent IP Directory

Bots vs Browsers - database of 196,862 user agents and growing

2008.6.19 - And we're back...

So to break the silence on the blog for the last few months, I just wanted to give a little shout-out to the Wget/1.5.3.1 bot at 70.238.66.172 for making it onto my banned IP list. This bot was banned because they severely abused our bandwidth over the last few days. Since this site is informational and we like to catch bots "in the wild", we rarely impose restrictions on the bots that visit. However, this bot hit us 82,000+ times in just a few hours today, and over 50,000 times in the last 3 days. After today's volume, we banned them.

Sorry about the delay between posts - alot of work has happened mainly on our other sites over the last few months, and that consumed our time. I'll start posting more frequently now that we are out of the woods on the principal development of our newest sites. For the sake of keeping this blog's integrity, I'll refrain from shameless promotion of those sites here...

As far as growth on the site, you should check out our iPhone category - it is our most visited category so far this year.

In other news, we have now reached 181,492 user agents and 1,951 bots

Blog Archives:

2008.8.3

Here comes August...
2008.7.13

2,000 bots!
2008.7.6

Dog Days of Summer Bots
2008.6.23

Another one bites the dust
2008.6.22

Bots don't run out of gas
2008.6.19

And we're back...
2008.1.21

Happy 2nd Birthday!
2007.10.25

The Creature Post
2007.9.7

iTunes, Facebook, Google Earth, and more
2007.7.22

Hot Summer Bots
2007.7.6

The Apple iPhones have landed!
2007.6.13

Twiceler calls off the bots
2007.6.13

Twiceler Strikes!
2007.6.3

Land of 1,000 bots
2007.4.22

April Bots Bring May Traffic... (we hope)
2007.4.16

Spring Cleaning in the Web Traffic Logs
2007.3.24

March Bot Madness
2007.3.10

Got Spiders?
2007.2.24

Some New Faces (bots, of course)
2007.2.10

Winks, DataFountains, Hijacks, and Tool - what's the connection?
2007.2.3

February Stars
2007.1.12

Happy 1st Birthday!
2007.1.1

The 2007 bots are in!
2006.12.23

Have a Merry-Bot-Christmas
2006.12.12

50,000 User Agents!
2006.11.4

2 weeks, 19 new bots
2006.10.17

2 weeks, 30 bots
2006.10.2

4 weeks, 23 bots
2006.9.9

Playing catchup with the bots
2006.8.26

500 bots!
2006.8.20

5 days, 8 bots
2006.8.15

Two weeks, 15 new bots
2006.8.2

Another week, another gang of new bots
2006.7.25

40,000 User Agents!!!
2006.7.4

New category, bot revisions, and 6 new bots for July 4th
2006.6.25

New batch of imports!
2006.6.18

5 new bots, just in time for Father's Day!
2006.6.4

8 new bots for the database
2006.5.19

A couple new sightings
2006.5.9

Quiet week, one new bot
2006.5.2

A few new bots
2006.4.20

A quick bot-sighting update
2006.4.12

More user agents, more bots
2006.3.19

5,000+ New User Agents
2006.3.9

42 more bots, lots of new user agents
2006.2.19

New Bots and Browsers just addded!
2006.1.25

Welcome to Bots vs Browsers!
2006.1.17

Welcome to the User Agents Database that has no name yet!
2006.1.12

Day One




Supported by Aptitude Technology Limited