[ic] search engine indexing scan/ MM=0f73bb47ac44f4e422.....

[Peter]

On 06/17/2006 05:03 AM, Kevin Walsh wrote:
> Another way would be to recognise spiders and reduce the size of the
> HTML output.  Only showing a list of links to products (dropping all
> the nice user-orientated stuff like prices and images) is one way to
> do that.

Be careful about doing that.  Google has been known to blacklist sites 
that return a different page to thier spiders than what gets shown to a 
regular browser.

Peter