[ic] New Robot UAs

[Justin La Sotten]

Everyone,

I've been going through Apache data lately and have discovered at
least two new robots
that ought to be added to robots.cfg:

1) 'bingbot'
http://www.bing.com/toolbox/blogs/webmaster/archive/2010/06/28/bing-crawler-bingbot-on-the-horizon.aspx

Looks like Microsoft has changed the UA for MSNBot, but Interchange is
no longer recognizing it.

2) 'facebookexternalhit'
http://www.facebook.com/externalhit_uatext.php

This is really only relevant for webmasters that have done some sort
of facebook integration; ie. Like Button, Facebook Connect


We'll continue pouring over the robot data, we'll let you know if we
come up with anymore.

-- 
Regards,
Justin La Sotten
FragranceNet.com