[ic] add to robots.cfg ?

DB db at m-and-d.com
Wed Dec 18 19:52:19 UTC 2013

Previous message: [ic] bad robots - undefined session ids?
Next message: [ic] add to robots.cfg ?
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

This seems to have obtained a session id:

msnbot-65-55-208-52.search.msn.com

Should we add this?

RobotHost <<EOR
    msnbot*
    ....


DB

Previous message: [ic] bad robots - undefined session ids?
Next message: [ic] add to robots.cfg ?
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

More information about the interchange-users mailing list