Anyone else seeing this traffic (webmasters)

handyman · 13-12-2006, 10:58

All of a sudden I am seeing a fantastic amount of traffic from a unknown web spider. It's had 50meg of my bandwidth already and has knocked googlebot off the top.

Can't seem to work out what it is as well.

[img]Download Failed (1)[/img]

Any ideas?

bopdude · 13-12-2006, 11:11

I can't help ( big supprise :rolleyes ) but a google brought up a list of other sites with the same problem, being talked about everywhere bythe looks of it. A lot of peeps sayingto use a prog called trap the spider

Quote:

Originally Posted by site

A spider trap is a script or series of scripts designed to attract a search engine spider and keep it in the spider trap until it has been determined that is a search engine spider.

HTH

handyman · 13-12-2006, 11:21

Cheers bop, I looked into that and it looks good.

One of the problems is not having time to go through the site lods several time a say. It logs the last 100 hits but this rarely covers more than a few hours so it's a case of checking more

Knobbly · 13-12-2006, 12:47

Quote:

Originally Posted by handyman

All of a sudden I am seeing a fantastic amount of traffic from a unknown web spider. It's had 50meg of my bandwidth already and has knocked googlebot off the top.

Can't seem to work out what it is as well.

Any ideas?

In awstats it'll give you a time and date of the last time it visited, cross reference that with your raw log file to find the IP address

chickendippers · 14-12-2006, 09:43

Yes, and I've also started getting lots of spam posts on my forum and fake file uploads.