What would cause a sudden huge spike in crawling rate from google ??

4 replies
  • SEO
  • |
So I have been checking my webmaster tools lately and in the crawl stats, there has been a very huge spike in crawl rates I noticed. My crawl rate per day was between 10,000 to 15,000 pages per day now it spiked to 150,000 per day 4 days ago , the day after that it was 170,000 pages per day .. now it spiked even more to 265,000 pages per day. At this pace, it may even start crawling a million page a day very soon.

I have to say that I'm quite happy to see such a huge spike but I'm wondering what caused it. I am suspecting that it may be due to the fact that I disavowed by really bad links a few days ago. I also did some changes to my site and my some of my urls changed structure. The thing is that I had done similar changes in the past but I never noticed such a huge spike. Maybe I did some things right this time. .. I really don't know. I was wondering if any of you had a similar experience.

I have been so busy with work that I kinda forgot to keep up with my SEO routine. Now I am back at it. Wanna take good care of this site and see where things go.
#crawling #google #huge #rate #spike #sudden
  • Profile picture of the author dave_hermansen
    Maybe you alerted Google to some pages they didn't even have indexed that were linking to you. Now, they are crawling those sites to see what's up and following the links to pages on your site.

    In the end, I wouldn't care how often my site was crawled unless I was a breaking news site or one that is constantly cranking out new content. I'd be much more concerned with the rank and number of pages that rank as well as the number of pages that Google was indexing on my site. Did any of those numbers change? Those are the numbers that really matter.
    Signature
    BizSellers.com - The #1 place to buy & sell websites!
    We help sellers get the MAXIMUM amount for their websites and all buyers know that these sites are 100% vetted.
    {{ DiscussionBoard.errors[11002629].message }}
  • Profile picture of the author whitecap
    How many pages do you have on your site?
    {{ DiscussionBoard.errors[11004702].message }}
    • Profile picture of the author mase857
      Many , like 750,000 pages because it's a multi-lingual site, international site.
      {{ DiscussionBoard.errors[11005248].message }}
  • Profile picture of the author Gary Chapple
    Sometimes the crawl rate can be counter productive by slowing down your server if you experience that you may find this google article helpful as it is possible to slow it.
    https://support.google.com/webmaster...er/48620?hl=en
    {{ DiscussionBoard.errors[11005257].message }}

Trending Topics