mod_rewrite and robots was: [ic] New user question

[Chris Jesseman]

You can use Apache mod_rewrite to control URL based on user agent. Anyone tried 
ajustments of URL for robots on IC?

I've used simple rewrite rules over MV and they have worked very well in the 
past.

-Chris

Quoting Doug Alcorn <doug@lathi.net>:

> "Dan Garwood" <res087jh@verizon.net> writes:
> 
> > Michelle,
> > 
> > If your hosting company does not setup the mod_minivend, than search
> engines
> > will have trouble indexing you. 
> 
> I'm not sure what mod_minivend does; this is the first I've heard of
> it.  However, there was a good article posted here back on 06 Oct 00
> by Jonathan Clark on the thread for "Meta Tags".  In it he talks about
> strategies for allowing robots to scan you.  Note that his article
> doesn't mention mod_minivend.  Note that I'm not disparaging
> mod_minivend.  I don't know anything about it.  It may be the answer
> to all my indexing woes.  All I'm saying is there are some
> alternatives. 
> 
> > 
> > > -----Original Message-----
> > > From: interchange-users-admin@lists.akopia.com
> > > [mailto:interchange-users-admin@lists.akopia.com]On Behalf Of
> Michelle
> > > Sent: Tuesday, January 30, 2001 12:18 PM
> > > To: interchange-users@lists.akopia.com
> > > Subject: [ic] New user question
> > >
> > > Question: Interchange creates dynamic pages. Does this mean all
> > > sections of the page are created on the fly or are the pages
> > > static with only the product info created on the fly? Hope this
> > > makes sense.
> 
> Unless you explicitly build static pages, everything is dynamic.  That
> means the entire content of all the pages are generated from a cgi
> program.  To have part of the page static and part dynamic would
> require use of Server Side Includes.  I've never done any SSI and
> don't know if the SS included file can actually be the output of a cgi
> script.  On the surface, this seems like it could be pretty cool; but,
> IC is certainly not designed that way.
> 
> > > I am concerned about being indexed by search engines (Excite,
> > > etc.) if there are no pages to index. What parts of the page are
> > > available to the search engines?
> 
> I recommend going to google and searching on "Jonathan Clark Meta Tags
> site: akopia.com".
> 
> -- 
>  (__) Doug Alcorn (mailto:doug@lathi.net http://www.lathi.net)
>  oo / PGP 02B3 1E26 BCF2 9AAF 93F1  61D7 450C B264 3E63 D543
>  |_/  If you're a capitalist and you have the best goods and they're
>       free, you don't have to proselytize, you just have to wait. 
> 
> 
> _______________________________________________
> Interchange-users mailing list
> Interchange-users@lists.akopia.com
> http://lists.akopia.com/mailman/listinfo/interchange-users
> 



Chris Jesseman, President
http://www.sitemajic.net