PDA

View Full Version : Weird Google robot activity


Drewbert
9th February 2009, 07:33 AM
Just in the last day my server has been hit by a robot from inside Google's network (72.14.193.*) that does not give a browser ID, and has been pulling the main page of IDN's hosted on the server. Ignores ascii domains, only goes for IDN's.

and the ip #'s used don't resolve to hostnames.

Weird.

Anyone else seeing it?

Drewbert
9th February 2009, 08:17 AM
Looking deeper into the logs, I think it's related to Google's Webmaster Tools.

It spiders site in strict alphabetical order, .com first, in alphabetical order, then .net later.

I just wish the damn thing wouldn't asked for 30 different sites ALL AT THE SAME TIME.