Re: Virgin Media Phorm Webwise Adverts [Updated: See Post No. 1, 77, 102 & 797]
I now have absolute confirmation that it is googlebot and googlebot only that Phorm looks for in robots.txt:
Email from me to Emma Sanderson of BT:
Quote:
Emma,
Sorry to be a pain, but just to be absolutely 100% clear on this, if I had the following robots.txt file:
User-agent: msnbot
Disallow:
User-agent: *
Disallow: /
visitors would not be profiled because googlebot is not allowed.
Regards
John
|
Reply from Emma Sanderson:
Quote:
Mr Elvin
In this scenario, the page wouldn't be profiled during its transmission to the user who requested it, because with exception of msn no other bots are allowed.
Regards
Emma
|
|