[ic] RobotUA

Kevin Walsh interchange-users@icdevgroup.org
Thu Nov 21 19:17:00 2002


Grant [listbox@email.com] wrote:
> 
> I just defined RobotUA in my 4.9.3 store, and I was wondering if anyone
> would be willing to post their list of spider UAs.  Here's mine:
> 
> RobotUA *google*, *Google*, *scooter*, *Scooter*, *spider*, *Spider*,
> *ultraseek
> *, *Ultraseek*, *infoseek*, *Infoseek*, *lycos*, *Lycos*, *sidewinder*,
> *Sidewin
> der*, *architext*, *Architext*, *gulliver*, *Gulliver*, *mercator*,
> *Mercator*,
> *slurp*, *Slurp*
>
Here's mine:

RobotUA <<EOR
    ATN_Worldwide, AltaVista, Arachnoidea, Aranha, Architext, Ask, Atomz,
    BackRub, Builder, CMC, Contact, Digital*Integrity, Directory, EZResult,
    Excite, FAST, Ferret, Fireball, Google, Gromit, Gulliver, Harvest, Hubater,
    H?m?h?kki, INGRID, IncyWincy, Jack, KIT*Fireball, Kototoi, LWP, Lycos,
    MegaSheep, Mercator, Nazilla, NetMechanic, NetResearchServer, NetScoop,
    Offline, ParaSite, Refiner, RoboDude, Rover, Rutgers, Scooter, Slurp,
    Spyder, T-H-U-N-D-E-R-S-T-O-N-E, Toutatis, Tv*Merc, Valkyrie, Voyager,
    WIRE, Walker, WebCopier, Wget, WhizBang, Wire, Wombat, Yahoo, Yandex,
    ZyBorg, agent, ah-ha, appie, archiver, asterias, bot, contact, collector,
    crawl, fido, find, gazz, grabber, griffon, ip3000, legs, marvin, mirago,
    moget, newscan, roach, seek, speedy, spider, suke, tarantula, topiclink,
    whowhere, winona, worm, xtreme,
EOR

The RobotUA directive in the later 4.9.x versions are case insensitive
so you don't need to specify both "google" and "Google".  There's also
no need to use wildcards before and after each keyword.

> 
> All you have to do is add something like this anywhere in interchange.cfg
> and restart right?
> 
Correct.

-- 
   _/   _/  _/_/_/_/  _/    _/  _/_/_/  _/    _/
  _/_/_/   _/_/      _/    _/    _/    _/_/  _/   K e v i n   W a l s h
 _/ _/    _/          _/ _/     _/    _/  _/_/    kevin@cursor.biz
_/   _/  _/_/_/_/      _/    _/_/_/  _/    _/