Comments on: Finding Google’s Stealth IPs (Part 1)

By: elhoim

elhoim — Thu, 03 Jul 2008 09:25:29 +0000

@Jabber: some solutions are (if you are really paranoid):
1) invest in a maxmind ISP IP ranges database (15$ + 3$/month for updates)
2) the free DUHL DNSBL from SORBS @ http://www.us.sorbs.net/faq/dul.shtml

If the visitor do not come from one of those ranges, consider it as spider.
I would recommend to log the IP/AS number of the ranges you disallow and then do a list by ASN sorted by count of disallowed access so that you can white-list them after some verifications that it is a consumer range.

By: Windtalker

Windtalker — Tue, 24 Jun 2008 18:56:15 +0000

I’m a bit late to this post but still this is a very good post. Thanks shady

By: Jabber

Jabber — Tue, 29 Jan 2008 09:58:00 +0000

A late post on this topic but I just assumed Google would be regularly setting up and rotating external VPS servers on 3rd party ISPs running Squid Web Proxy Cache or something similar (they probably have their own software).
The web cache would be accessible to Google staff/bots with an anonymous external facing IP.
So its technically very easy for them to hide their origin IP when they choose to. Just a case of avoiding drawing attention to your site as much as you can so they dont feel the need to look in the first place.

By: elhoim

elhoim — Mon, 28 Jan 2008 22:28:24 +0000

Corrected version of the above post.. It is possible to find all google IP adresses because to be reachable they need to declare it trough the BGP routing protcol under their Autonomous System Number which is 15169 , and tadaam, you have their ranges .... :) If they are really spooky, they are maybe using the IP of their acquisitions: Youtube ranges , Postini ranges, etc...