|
|
|
|
Bots vs Browsers - database of 186,339 user agents and growing
|
2006.8.20 - 5 days, 8 bots
In the brief 120 hours since my last post, we've encountered 8 new bots.
At this rate, to make sure we don't get behind, here's the news on these new bots:
-
A new version of TurnitinBot/2.0 came by.
According to their site, Turnitin indexes content on the web to compare to student's school work, to try and detect plagiarism.
We are flattered that this bot felt the need to crawl our site, and would be even more flattered if a student ever plagiarized our content.
related...
-
In other news, WeRelateBot/0.9
searched our site for content related to ancestry.
WeRelate.org owns this bot, and their site allows you to discover information about your family's history.
It really is a smart move to crawl a website about bots to harvest content about human ancestry...
related...
-
Startup search engine "Sproose" sent a new crawler by,
sproose/0.1.
According to the Sproose home page, their "personalized search" technology is still in the works, so keep an eye out for this new service to launch.
related...
-
NimbleCrawler dropped in a new version this week, debuting
NimbleCrawler 2.0.1.
related...
-
MSN showed up to the party with a new MSN Bot, msnbot-Products/1.0.
related...
-
Never seen this one before... Mozilla/5.0 crawl@digigetx.com
Safe to say it's a bot from the "crawl" part of the User Agent.
For more information, drop them a line at crawl@digigetx.com - they didn't include their email for nothing.
related...
-
Microsoft Research sent it's bot by, MSRBOT, for a look around our sites.
related...
-
And finally, our weekly findlinks version iteration came by like clockwork this week, now reporting version
findlinks/1.1.3-beta8.
related...
The week concludes, putting our database at 41,818 user agents and 492 bots
|
Archives: |
2008.7.6
|
Dog Days of Summer Bots
|
2008.6.23
|
Another one bites the dust
|
2008.6.22
|
Bots don't run out of gas
|
2008.6.19
|
And we're back...
|
2008.1.21
|
Happy 2nd Birthday!
|
2007.10.25
|
The Creature Post
|
2007.9.7
|
iTunes, Facebook, Google Earth, and more
|
2007.7.22
|
Hot Summer Bots
|
2007.7.6
|
The Apple iPhones have landed!
|
2007.6.13
|
Twiceler calls off the bots
|
2007.6.13
|
Twiceler Strikes!
|
2007.6.3
|
Land of 1,000 bots
|
2007.4.22
|
April Bots Bring May Traffic... (we hope)
|
2007.4.16
|
Spring Cleaning in the Web Traffic Logs
|
2007.3.24
|
March Bot Madness
|
2007.3.10
|
Got Spiders?
|
2007.2.24
|
Some New Faces (bots, of course)
|
2007.2.10
|
Winks, DataFountains, Hijacks, and Tool - what's the connection?
|
2007.2.3
|
February Stars
|
2007.1.12
|
Happy 1st Birthday!
|
2007.1.1
|
The 2007 bots are in!
|
2006.12.23
|
Have a Merry-Bot-Christmas
|
2006.12.12
|
50,000 User Agents!
|
2006.11.4
|
2 weeks, 19 new bots
|
2006.10.17
|
2 weeks, 30 bots
|
2006.10.2
|
4 weeks, 23 bots
|
2006.9.9
|
Playing catchup with the bots
|
2006.8.26
|
500 bots!
|
2006.8.20
|
5 days, 8 bots
|
2006.8.15
|
Two weeks, 15 new bots
|
2006.8.2
|
Another week, another gang of new bots
|
2006.7.25
|
40,000 User Agents!!!
|
2006.7.4
|
New category, bot revisions, and 6 new bots for July 4th
|
2006.6.25
|
New batch of imports!
|
2006.6.18
|
5 new bots, just in time for Father's Day!
|
2006.6.4
|
8 new bots for the database
|
2006.5.19
|
A couple new sightings
|
2006.5.9
|
Quiet week, one new bot
|
2006.5.2
|
A few new bots
|
2006.4.20
|
A quick bot-sighting update
|
2006.4.12
|
More user agents, more bots
|
2006.3.19
|
5,000+ New User Agents
|
2006.3.9
|
42 more bots, lots of new user agents
|
2006.2.19
|
New Bots and Browsers just addded!
|
2006.1.25
|
Welcome to Bots vs Browsers!
|
2006.1.17
|
Welcome to the User Agents Database that has no name yet!
|
2006.1.12
|
Day One
|
|
|
|
|