Cable Forum - View Single Post

handyman · 11-11-2009, 12:54

Can't Murdock just use spider.txt to block search engine spiders from certain parts of his sites? This is not a new thing to be able to do in fact it's a basic part of running any website.

He'd be well hacked off though if Google did not index his site at all. I run a small site and we would lose over £50,000 revenue PA if Google did not list us.

11-11-2009, 12:54	#21
handyman Permanently Banned Join Date: Jun 2003 Location: Nr Carnforth Age: 50 Services: M6 Keele Posts: 5,462	Re: Murdoch may block Google searches Can't Murdock just use spider.txt to block search engine spiders from certain parts of his sites? This is not a new thing to be able to do in fact it's a basic part of running any website. He'd be well hacked off though if Google did not index his site at all. I run a small site and we would lose over £50,000 revenue PA if Google did not list us.