Bots vs Browsers - Public Bot / User Agent Database & Commentary

Bots vs Browsers - database of 1,522,189 user agents and growing


JUN 19

2008

And we're back...



So to break the silence on the blog for the last few months, I just wanted to give a little shout-out to the Wget/1.5.3.1 bot at 70.238.66.172 for making it onto my banned IP list. This bot was banned because they severely abused our bandwidth over the last few days. Since this site is informational and we like to catch bots "in the wild", we rarely impose restrictions on the bots that visit. However, this bot hit us 82,000+ times in just a few hours today, and over 50,000 times in the last 3 days. After today's volume, we banned them.

Sorry about the delay between posts - alot of work has happened mainly on our other sites over the last few months, and that consumed our time. I'll start posting more frequently now that we are out of the woods on the principal development of our newest sites. For the sake of keeping this blog's integrity, I'll refrain from shameless promotion of those sites here...

As far as growth on the site, you should check out our iPhone category - it is our most visited category so far this year.

In other news, we have now reached 181,492 user agents and 1,951 bots

Blog Archives:


FEB 29

2016

Leap Day Launch!











APR 18

2009

Where did Palm go?







JUL 13

2008

2,000 bots!





JUN 19

2008

And we're back...


JAN 21

2008

Happy 2nd Birthday!


OCT 25

2007

The Creature Post



JUL 22

2007

Hot Summer Bots




JUN 13

2007

Twiceler Strikes!


JUN 3

2007

Land of 1,000 bots




MAR 24

2007

March Bot Madness


MAR 10

2007

Got Spiders?




FEB 3

2007

February Stars


JAN 12

2007

Happy 1st Birthday!




DEC 12

2006

50,000 User Agents!



OCT 17

2006

2 weeks, 30 bots


OCT 2

2006

4 weeks, 23 bots



AUG 26

2006

500 bots!


AUG 20

2006

5 days, 8 bots











MAY 2

2006

A few new bots









JAN 12

2006

Day One


USER AGENT CATEGORIES

BOTS
BROWSERS
MOBILE BROWSERS
OLD SCHOOL
OTHER
SPAM / HACKS
  • Script Injections (297)
  • SQL Injection (7,697)
  • PHP Injection (1,435)
  • XSS Attacks (58)
  • Link Injection (250,836)