[interchange-cvs] interchange - kwalsh modified dist/robots.cfg
interchange-cvs at icdevgroup.org
interchange-cvs at icdevgroup.org
Sun Sep 2 15:22:08 EDT 2007
User: kwalsh
Date: 2007-09-02 19:22:08 GMT
Modified: dist robots.cfg
Log:
* More non-browsers for the grinder.
Revision Changes Path
2.7 +3 -0 interchange/dist/robots.cfg
rev 2.7, prev_rev 2.6
Index: robots.cfg
===================================================================
RCS file: /var/cvs/interchange/dist/robots.cfg,v
retrieving revision 2.6
retrieving revision 2.7
diff -u -r2.6 -r2.7
--- robots.cfg 9 Aug 2007 11:11:47 -0000 2.6
+++ robots.cfg 2 Sep 2007 19:22:08 -0000 2.7
@@ -90,9 +90,11 @@
Nutch,
Ocelli,
ozelot,
+ ozzie,
pagebull,
ParaSite,
pavuk,
+ POE-Component,
Pokey,
Pompos,
Refiner,
@@ -141,6 +143,7 @@
WordPress,
worm,
wwwster,
+ WWW-Mechanize,
xtreme,
Yahoo,
Yandex,
More information about the interchange-cvs
mailing list