View Single Post
Old 31-07-2008, 17:07   #13013
isf
Inactive
 
Join Date: Apr 2006
Posts: 73
isf is an unknown quantity at this point
Re: Virgin Media Phorm Webwise Adverts [Updated: See Post No. 1, 77, 102 & 797]

Quote:
Originally Posted by oblonsky View Post
PHP/Apache site owners may be interested in this post, which starts the ball rolling if you are considering sending a custom robots.txt to Phorm which is different to the robots.txt you want to send to Google, MSN, Yahoo etc...
I could do this if there's sufficient interest although I don't consider robots.txt to be a suitable exclusion method. Phorm isn't a spider and is not indexing publicly linked content. They intercept pages swerved during authenticated user logon sessions. At the very least Phorm should append themselves to the UA string when they strip the phorged domain cookie from the request headers.
isf is offline