Quote:
Originally Posted by AlexanderHanff
Even if they do give us a user-agent string, it doesn't mean they will obey robots.txt they could choose to completely ignore it.
Alexander Hanff
|
Well the user agent is the browser you are using to view the site.
This links back to if you are using a non phorm compliant browser such as safari it cannot profile.
What other user agent can they send?
http://www.cableforum.co.uk/board/34...-post4626.html