[interchange-cvs] interchange - kwalsh modified dist/robots.cfg
interchange-cvs at icdevgroup.org
interchange-cvs at icdevgroup.org
Thu Sep 20 20:51:32 EDT 2007
User: kwalsh
Date: 2007-09-21 00:51:32 GMT
Modified: dist robots.cfg
Log:
* The yokels at Microsoft are using a bogus TLD for their MSN spider.
Revision Changes Path
2.8 +1 -0 interchange/dist/robots.cfg
rev 2.8, prev_rev 2.7
Index: robots.cfg
===================================================================
RCS file: /var/cvs/interchange/dist/robots.cfg,v
retrieving revision 2.7
retrieving revision 2.8
diff -u -r2.7 -r2.8
--- robots.cfg 2 Sep 2007 19:22:08 -0000 2.7
+++ robots.cfg 21 Sep 2007 00:51:32 -0000 2.8
@@ -176,6 +176,7 @@
*.inktomisearch.com,
*.lycos.com,
*.pa-x.dec.com,
+ *.phx.gbl,
add-url.altavista.com,
msnbot.msn.com,
westinghouse-rsl-com-usa.NorthRoyalton.cw.net,
More information about the interchange-cvs
mailing list