[interchange-cvs] interchange - kwalsh modified 3 files
interchange-cvs at icdevgroup.org
interchange-cvs at icdevgroup.org
Thu Mar 8 10:03:01 EST 2007
User: kwalsh
Date: 2007-03-08 15:03:01 GMT
Modified: dist interchange.cfg.dist
Modified: . MANIFEST
Added: dist robots.cfg
Log:
* Split the Robot* directives into their own "robots.cfg" file to make
it easier to keep the file up to date.
If, like me, you have multple Interchange instances per server,
then you can symlink all of the robots.cfg files together. This
means that you only have to edit one file to update all of the lists
used by all of the Interchange instances.
* Modified the Robot* lists to reflect the values currently in use on
my servers.
Revision Changes Path
2.10 +2 -27 interchange/dist/interchange.cfg.dist
rev 2.10, prev_rev 2.9
Index: interchange.cfg.dist
===================================================================
RCS file: /var/cvs/interchange/dist/interchange.cfg.dist,v
retrieving revision 2.9
retrieving revision 2.10
diff -u -r2.9 -r2.10
--- interchange.cfg.dist 21 Sep 2006 14:56:38 -0000 2.9
+++ interchange.cfg.dist 8 Mar 2007 15:03:01 -0000 2.10
@@ -119,30 +119,5 @@
# Include if you want non-English error messages. Not complete.
# include locale.error
-RobotUA <<EOR
- ATN_Worldwide, AltaVista, Arachnoidea, Aranha, Architext, Ask, Atomz,
- BackRub, Builder, CMC, Contact, Digital*Integrity, Directory, EZResult,
- Excite, Ferret, Fireball, GoogleBot, Gromit, Gulliver, Harvest, Hubater,
- H?m?h?kki, INGRID, IncyWincy, Jack, KIT*Fireball, Kototoi, LWP, Lycos,
- MegaSheep, Mercator, Nazilla, NetMechanic, NetResearchServer, NetScoop,
- ParaSite, Refiner, RoboDude, Rover, Rutgers, Scooter, Slurp, Spyder,
- T-H-U-N-D-E-R-S-T-O-N-E, Toutatis, Tv*Merc, Valkyrie, Voyager, WIRE,
- Walker, Wget, WhizBang, Wire, Wombat, Yahoo, Yandex, ZyBorg, appie,
- asterias, bot, contact, crawl, collector, fido, find, gazz, grabber,
- griffon, archiver, legs, marvin, mirago, moget, newscan, seek, speedy,
- spider, suke, tarantula, agent, topiclink, whowhere, winona, worm, xtreme,
-EOR
-
-RobotIP <<EOR
- 202.9.155.123, 204.152.191.41, 208.146.26.19,
- 208.146.26.233, 209.185.141.209, 209.185.141.211,
- 209.202.148.36, 209.202.148.41, 216.200.130.207,
- 216.35.103.6?, 216.35.103.70,
-EOR
-
-RobotHost <<EOR
- *.crawler*.com, *.excite.com, *.googlebot.com,
- *.infoseek.com, *.inktomi.com, *.inktomisearch.com,
- *.lycos.com, *.pa-x.dec.com, add-url.altavista.com,
- westinghouse-rsl-com-usa.NorthRoyalton.cw.net,
-EOR
+# Include the robot recognition lists
+include robots.cfg
2.1 interchange/dist/robots.cfg
rev 2.1, prev_rev 2.0
2.201 +1 -0 interchange/MANIFEST
rev 2.201, prev_rev 2.200
Index: MANIFEST
===================================================================
RCS file: /var/cvs/interchange/MANIFEST,v
retrieving revision 2.200
retrieving revision 2.201
diff -u -r2.200 -r2.201
--- MANIFEST 13 Oct 2006 16:39:28 -0000 2.200
+++ MANIFEST 8 Mar 2007 15:03:01 -0000 2.201
@@ -600,6 +600,7 @@
dist/lib/UI/vars/UI_STD_FOOTER
dist/lib/UI/vars/UI_STD_HEAD
dist/locale.error
+dist/robots.cfg
dist/src/compile.pl
dist/src/config.h.in
dist/src/configure
More information about the interchange-cvs
mailing list