[ic] Spiders and more lists again

[Rene]

On 03.09.2010 21:55, DB wrote:
>> What i did was the following. I added this to robots.txt
>>
>> User-agent: *
>> Disallow: /admin/
>> Disallow: /ord/
>> Disallow: /query/
>> Disallow: /scan/
>> Disallow: /account.html
>> Disallow: /process.html
>> Disallow: /search.html
> 
> [snip]
>> René
> 
> Thanks - I think that's a pretty good idea!

YEp, this way you can feed just your products-pages to google, and skip
all other pages that does not make any sense.. :-)

René