Quote:
|
Originally Posted by whyme38
How stupid can you get!
|
Agreed,
This could be a major blow for them.
i wonder who complained about a search engine displaying their material.
Although you can stop a spider from crawling along certain areas of a site with robots.txt albiet i realise that some spiders are set to ignore this file