PDA

View Full Version : adsense and googlebot



tomek
06-29-2004, 12:53 PM
I use adsense in my AWS book shop. When a page is displayed and google has not yet crawled that page it will be crawled later by google so that adsense ads can be displayed.

I understand that this has nothing to do how well you rank with that page in google but at least it guarantees that pages on which you use adsense will be crawled eventually and your pages will be added to google's index.

Am I right?
Or does this adsense-crawling have nothing to do with google's search index?

mobilebadboy
06-29-2004, 01:10 PM
They're separate. Googlebot is the search engine spider, Mediapartners-Google is the Adsense content crawler. It's strictly for crawling your site for content in order to match with related ads.

Although they come with the same hostname (crawler[x].googlebot.com), you can tell the difference with the User-Agent string.

Adsense Crawler: Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)
SE Spider: Googlebot/2.1 (+http://www.googlebot.com/bot.html)

tomek
06-29-2004, 01:27 PM
thanks for the info :)