Cable Forum - View Single Post

Richard M · 13-02-2004, 14:17

You could use WGET to spider the entire public site using HTTP.
Windows version: http://xoomer.virgilio.it/hherold/

Note that only files that are linked to will be downloaded, it acts pretty much the same as a search engine spider.

13-02-2004, 14:17	#8
Richard M Inactive Join Date: Jun 2003 Location: Los Angeles, CA Age: 47 Posts: 6,343	Re: Retrieving NTL Hosted WebPage You could use WGET to spider the entire public site using HTTP. Windows version: http://xoomer.virgilio.it/hherold/ Note that only files that are linked to will be downloaded, it acts pretty much the same as a search engine spider.