Coming into this a bit late I realise... but several pages back, some were saying that Google relied on implied consent to crawl websites...
Don't you have to physically add each site you wish them to index to their list of URLs, at
www.google.com/addurl
therefore inphormed consent is gained, by the act of you adding your site to their index?
Or have I got confused?
