|
|
|
|
Bots vs Browsers - database of 224,013 user agents and growing
|
2008.9.6 - 200,000 User Agents!
The last month was very exciting, since we broke 200,000 user agents!
It was almost exactly a year ago that we broke 100,000 user agents, and almost 2 years since we broke 50,000 user agents.
How the time flies by.
Here are some bots that seemed interesting to us this month as we head further into September:
-
The Internet Ninja 6.0 leads off the list for this month of new bots.
However, a good Ninja would visit a web site and not leave footprints behind in the weblogs.
related...
-
This bot has some of the best movie references - they managed to squeeze "Terminator" and "2001 : Space Odyssey" references into one user agent:
HAL 9000; Cyberdyn X3; T1000 autonomous
related...
-
Another new bot, CydralSpider/3.0, crawls for a "Visual Search Engine" named Cydral.
related...
-
The ShrinkTheWeb.com Crawler v1.0
bot crawls pages on the web to produce a thumbnail of each page.
According to their site, "ShrinkTheWeb is the most powerful, free website thumbnail provider".
In the fine print, they allow up to 250,000 free thumbnails per month for free, and pay services extend beyond that.
related...
-
We had 2 toasters drop in - the first one,
WebToaster V0.9 Alpha,
was nice enough, but the second one attempted HTML injection on our site to hijack a free link:
</a><a href='http://www.webtoaster.com'>WebToaster</a> - WebToaster V0.9 Alpha.
Shame, shame, we know your name, and now everyone that reads our site does too.
related...
-
Nutch made a big splash in our logs this month with quite a few new user agent variations: related...
-
We also got some new curls this month - Perl interface for libCURL,
curl/7.16.4,
curl/7.18.0, and
curl/7.15.3.
related...
-
Here's the rundown on some other interesting bots that dropped in over the last month:
We are now at 200,000 user agents and 2,194 bots.
|
Blog Archives: |
2008.11.23
|
Bots should be thankful
|
2008.10.22
|
Would you say I have a plethora of new bots?
|
2008.9.6
|
200,000 User Agents!
|
2008.8.3
|
Here comes August...
|
2008.7.13
|
2,000 bots!
|
2008.7.6
|
Dog Days of Summer Bots
|
2008.6.23
|
Another one bites the dust
|
2008.6.22
|
Bots don't run out of gas
|
2008.6.19
|
And we're back...
|
2008.1.21
|
Happy 2nd Birthday!
|
2007.10.25
|
The Creature Post
|
2007.9.7
|
iTunes, Facebook, Google Earth, and more
|
2007.7.22
|
Hot Summer Bots
|
2007.7.6
|
The Apple iPhones have landed!
|
2007.6.13
|
Twiceler calls off the bots
|
2007.6.13
|
Twiceler Strikes!
|
2007.6.3
|
Land of 1,000 bots
|
2007.4.22
|
April Bots Bring May Traffic... (we hope)
|
2007.4.16
|
Spring Cleaning in the Web Traffic Logs
|
2007.3.24
|
March Bot Madness
|
2007.3.10
|
Got Spiders?
|
2007.2.24
|
Some New Faces (bots, of course)
|
2007.2.10
|
Winks, DataFountains, Hijacks, and Tool - what's the connection?
|
2007.2.3
|
February Stars
|
2007.1.12
|
Happy 1st Birthday!
|
2007.1.1
|
The 2007 bots are in!
|
2006.12.23
|
Have a Merry-Bot-Christmas
|
2006.12.12
|
50,000 User Agents!
|
2006.11.4
|
2 weeks, 19 new bots
|
2006.10.17
|
2 weeks, 30 bots
|
2006.10.2
|
4 weeks, 23 bots
|
2006.9.9
|
Playing catchup with the bots
|
2006.8.26
|
500 bots!
|
2006.8.20
|
5 days, 8 bots
|
2006.8.15
|
Two weeks, 15 new bots
|
2006.8.2
|
Another week, another gang of new bots
|
2006.7.25
|
40,000 User Agents!!!
|
2006.7.4
|
New category, bot revisions, and 6 new bots for July 4th
|
2006.6.25
|
New batch of imports!
|
2006.6.18
|
5 new bots, just in time for Father's Day!
|
2006.6.4
|
8 new bots for the database
|
2006.5.19
|
A couple new sightings
|
2006.5.9
|
Quiet week, one new bot
|
2006.5.2
|
A few new bots
|
2006.4.20
|
A quick bot-sighting update
|
2006.4.12
|
More user agents, more bots
|
2006.3.19
|
5,000+ New User Agents
|
2006.3.9
|
42 more bots, lots of new user agents
|
2006.2.19
|
New Bots and Browsers just addded!
|
2006.1.25
|
Welcome to Bots vs Browsers!
|
2006.1.17
|
Welcome to the User Agents Database that has no name yet!
|
2006.1.12
|
Day One
|
|
|
|
|