GoogleBot History Question

3 replies
  • SEO
  • |
I know that I can look at my Cached information in Google for my site and see the last Time Google crawled my site, but does anyone know if there is a way to tell when it was crawled before that? Like a list of times it was crawled?

Thanks

Seb
#googlebot #history #question
  • Profile picture of the author Ben Roy
    In the webmaster tools they show some information about frequency of crawling, pages pre day, etc. There's a graph. It's not terribly detailed. If you want lots of detail about what's happening, you'd need to go to your web server logs. That will show you every single page request that the crawler (all crawlers, really) make to your site.
    {{ DiscussionBoard.errors[1096316].message }}
  • Profile picture of the author Peter Adamson
    Your own web logs, if you keep them. Unfortunately most hosting providers bin them after just a few days so if you don't download them regularly you lose them. If you keep your logs, use Sawmill or something similar and you can get all the information you want.
    Signature
    Could You Be Squeezing More Sales Out Of Your Traffic ?
    Free Report
    {{ DiscussionBoard.errors[1096604].message }}
  • Profile picture of the author Sebulba
    Thanks for the help

    Seb
    {{ DiscussionBoard.errors[1097222].message }}

Trending Topics