Quote:
Originally Posted by isf
I can specify "User-agent: Googlebot" and a specific rule in my robots.txt, it's BT are telling us there's implied consent and that site operators can opt out. We need a UA to do that effectively. Not every site has access to robots.txt if they want to continue down this "implied consent" route, they need to append the UA string for requests accordingly.
|
Agreed with all the above. Sadly I don't think a UA for Phorm will ever exist though. If it wants to win over the web it really ought to though I do agree.
---------- Post added at 18:12 ---------- Previous post was at 18:11 ----------
Quote:
Originally Posted by Peter N
Honor and respect...
There's a phrase you wouldn't expect to see in a discussion about Phorm.
|
Glad the irony was not lost