[ic] Robots

[Steve Graham]

> Hi - just for fun I visited
> http://about.ask.com/en/docs/about/webmasters.shtml#8 which says that
> Ask's current spider reports itself as
>
> User-Agent: Mozilla/2.0 (compatible; Ask Jeeves/Teoma)
>
>
> I do see such entires in my sites access log, but my current robots.cfg
> appears to have no such entry. Perhaps someone who is able should make
> that change?
>
> DB
>

There was a discussion recently about RobotUA, but I couldn't find the 
reference.

Check here for the current github version:
http://github.com/interchange/interchange/tree/master/dist/

Steve