[interchange-cvs] interchange - kwalsh modified 3 files

interchange-cvs at icdevgroup.org interchange-cvs at icdevgroup.org
Thu Mar 8 10:03:01 EST 2007


User:      kwalsh
Date:      2007-03-08 15:03:01 GMT
Modified:  dist     interchange.cfg.dist
Modified:  .        MANIFEST
Added:     dist     robots.cfg
Log:
    * Split the Robot* directives into their own "robots.cfg" file to make
      it easier to keep the file up to date.

      If, like me, you have multple Interchange instances per server,
      then you can symlink all of the robots.cfg files together.  This
      means that you only have to edit one file to update all of the lists
      used by all of the Interchange instances.

    * Modified the Robot* lists to reflect the values currently in use on
      my servers.

Revision  Changes    Path
2.10      +2 -27     interchange/dist/interchange.cfg.dist


rev 2.10, prev_rev 2.9
Index: interchange.cfg.dist
===================================================================
RCS file: /var/cvs/interchange/dist/interchange.cfg.dist,v
retrieving revision 2.9
retrieving revision 2.10
diff -u -r2.9 -r2.10
--- interchange.cfg.dist	21 Sep 2006 14:56:38 -0000	2.9
+++ interchange.cfg.dist	8 Mar 2007 15:03:01 -0000	2.10
@@ -119,30 +119,5 @@
 # Include if you want non-English error messages. Not complete.
 # include locale.error
 
-RobotUA <<EOR
-    ATN_Worldwide, AltaVista, Arachnoidea, Aranha, Architext, Ask, Atomz,
-    BackRub, Builder, CMC, Contact, Digital*Integrity, Directory, EZResult,
-    Excite, Ferret, Fireball, GoogleBot, Gromit, Gulliver, Harvest, Hubater,
-    H?m?h?kki, INGRID, IncyWincy, Jack, KIT*Fireball, Kototoi, LWP, Lycos,
-    MegaSheep, Mercator, Nazilla, NetMechanic, NetResearchServer, NetScoop,
-    ParaSite, Refiner, RoboDude, Rover, Rutgers, Scooter, Slurp, Spyder,
-    T-H-U-N-D-E-R-S-T-O-N-E, Toutatis, Tv*Merc, Valkyrie, Voyager, WIRE,
-    Walker, Wget, WhizBang, Wire, Wombat, Yahoo, Yandex, ZyBorg, appie,
-    asterias, bot, contact, crawl, collector, fido, find, gazz, grabber,
-    griffon, archiver, legs, marvin, mirago, moget, newscan, seek, speedy,
-    spider, suke, tarantula, agent, topiclink, whowhere, winona, worm, xtreme,
-EOR
-
-RobotIP <<EOR
-    202.9.155.123,      204.152.191.41,         208.146.26.19,
-    208.146.26.233,     209.185.141.209,        209.185.141.211,
-    209.202.148.36,     209.202.148.41,         216.200.130.207,
-    216.35.103.6?,      216.35.103.70,
-EOR
-
-RobotHost <<EOR
-    *.crawler*.com,     *.excite.com,           *.googlebot.com,
-    *.infoseek.com,     *.inktomi.com,          *.inktomisearch.com,
-    *.lycos.com,        *.pa-x.dec.com,         add-url.altavista.com,
-    westinghouse-rsl-com-usa.NorthRoyalton.cw.net,
-EOR
+# Include the robot recognition lists
+include robots.cfg



2.1                  interchange/dist/robots.cfg


rev 2.1, prev_rev 2.0



2.201     +1 -0      interchange/MANIFEST


rev 2.201, prev_rev 2.200
Index: MANIFEST
===================================================================
RCS file: /var/cvs/interchange/MANIFEST,v
retrieving revision 2.200
retrieving revision 2.201
diff -u -r2.200 -r2.201
--- MANIFEST	13 Oct 2006 16:39:28 -0000	2.200
+++ MANIFEST	8 Mar 2007 15:03:01 -0000	2.201
@@ -600,6 +600,7 @@
 dist/lib/UI/vars/UI_STD_FOOTER
 dist/lib/UI/vars/UI_STD_HEAD
 dist/locale.error
+dist/robots.cfg
 dist/src/compile.pl
 dist/src/config.h.in
 dist/src/configure








More information about the interchange-cvs mailing list