Has Google changed the frequency of indexing?

8 replies
  • SEO
  • |
Actually I have a wordpress self hosted blog, earlier when I post an article to it, Google use to index my post within in minutes without any kind of pinging stuffs. But recently even after 2-3 days of posting of any article it is still not indexed by big G... Any thoughts on this?
#changed #frequency #google #indexing
  • Profile picture of the author paulgl
    Google does not just crawl a site when you create new content.
    That would make no sense. The frequency of a crawl is dictated
    by your site's history, and what google thinks of it. Every site
    is different. I can only guess that average for the regular
    googlebot is once every week to two weeks.

    If you have adsense, it theoretically gets crawled every time
    a page loads. The adsense bot is one of several googlebots.
    And they work in tandem. If one finds something, it can change
    SERP listings before the main one.

    (If you change a title tag, and you have adsense, chances are
    the title will get changed in listings rather quickly. The main bot
    might take longer by itself)

    One small reason to have adsense, I suppose.

    BTW, you cannot force google to do anything, and that means
    you can't force it to do things faster. When I create a new
    article on a site, it gets indexed on that same day. All sites,
    like I said, are different. You can(might, should) speed this up
    by becoming a site that google loves to crawl. That happens
    over time.

    Baidu, as a side note, seems to crawl my sites several times a day
    for some reason.

    Paul
    Signature

    If you were disappointed in your results today, lower your standards tomorrow.

    {{ DiscussionBoard.errors[8190737].message }}
    • Profile picture of the author RandySwanston
      Originally Posted by paulgl View Post

      Google does not just crawl a site when you create new content.
      That would make no sense. The frequency of a crawl is dictated
      by your site's history, and what google thinks of it. Every site
      is different. I can only guess that average for the regular
      googlebot is once every week to two weeks.

      If you have adsense, it theoretically gets crawled every time
      a page loads. The adsense bot is one of several googlebots.
      And they work in tandem. If one finds something, it can change
      SERP listings before the main one.

      (If you change a title tag, and you have adsense, chances are
      the title will get changed in listings rather quickly. The main bot
      might take longer by itself)

      One small reason to have adsense, I suppose.

      BTW, you cannot force google to do anything, and that means
      you can't force it to do things faster. When I create a new
      article on a site, it gets indexed on that same day. All sites,
      like I said, are different. You can(might, should) speed this up
      by becoming a site that google loves to crawl. That happens
      over time.

      Baidu, as a side note, seems to crawl my sites several times a day
      for some reason.

      Paul
      Hmmm, I am aware that we cannot force Google to do anything (instead it forces us to do many many thing lol).

      But the thing that I'm experiencing seems fishy.
      Signature
      {{ DiscussionBoard.errors[8193640].message }}
  • Profile picture of the author shanktan
    same here, I built 3 new niche website after the 2.0,and it has 100 content(no spun) on each side @ 14th this month.
    but after 5 days, google only show 30contest of mine(all the site same sisuation).
    {{ DiscussionBoard.errors[8191020].message }}
  • Profile picture of the author Icematikx
    When I used to run a celebrity news site, I would publish 4-5 articles daily along with other writers. We found that our articles would typically, get indexed within 20-30 minutes. Prior to that though, it could take days.

    I think it's all about consistency. If Google knows you update your content frequently, and frequently publish new relevant industry content, then they'll reward you with quick indexing and higher SERPs for those new posts.
    Signature

    Just got back from a #BrightonSEO. I was given room 404 in the hotel I stayed at. Couldn’t find it anywhere!

    {{ DiscussionBoard.errors[8191027].message }}
  • Profile picture of the author trade4861
    Do you submit the URL to the Google URL submission form? Works ever time for me. Gets articles indexed in 5 hours or less.
    {{ DiscussionBoard.errors[8195569].message }}
  • Profile picture of the author Curtis2011
    Originally Posted by RandySwanston View Post

    Actually I have a wordpress self hosted blog, earlier when I post an article to it, Google use to index my post within in minutes without any kind of pinging stuffs. But recently even after 2-3 days of posting of any article it is still not indexed by big G... Any thoughts on this?
    If you want your pages indexed as fast as possible, you need to update your sitemap and ping it to Google as soon as you add new content.

    I believe there are free Wordpress plugins available that will do both of these for you automatically.
    {{ DiscussionBoard.errors[8195611].message }}
  • Profile picture of the author zannix
    PM me with the URLs you want to have indexed. I'll index them for you in about 10 minutes. No catch.
    {{ DiscussionBoard.errors[8195658].message }}
  • Profile picture of the author justmoretravel
    Originally Posted by RandySwanston View Post

    Actually I have a wordpress self hosted blog, earlier when I post an article to it, Google use to index my post within in minutes without any kind of pinging stuffs. But recently even after 2-3 days of posting of any article it is still not indexed by big G... Any thoughts on this?
    I have no problems getting my posts indexed within 5 minutes. I manually submit each new piece of content using Google's "Fetch As Google" feature in Webmaster tools.

    I watch my stats (I use Wordfence Live View) and I usually see the Googlebot on my site as soon as I submit it, it then checks my comment feed. After about a minute or so I use the site: operator and I see my pages are in the index and already ranking for their keywords.

    The current site I'm working on is about a month old. Try using the feature in Webmaster tools and make sure you select "Submit to index" right after fetching it as Google.

    Edit: I wanted to add something about posts not showing up in the index. I currently have about 58 posts on this site and 38 of them are in the index. I looked through my articles and the twenty that are missing are posts that have clickbank products on them and the other 38 do not. So there is a possibility that the pages you're submitting have affiliate links Google does not want in its index.
    {{ DiscussionBoard.errors[8195699].message }}

Trending Topics