12 {{ upvoteCount | shortNum }}
12 {{ upvoteCount | shortNum }}

Has it ever happened with you

by cbnet
10 replies
  • SEO
    • |
I have a more than one year old site. My posts were being indexed by Google with in a minute of publishing them. I published my latest post more than 40 hrs. ago. It has not been indexed by Google yet. Has this happened ever with any one of you before.

What could be all the possible reasons for above.
#happened
  • Profile picture of the author IMPromocoder
    It can take a dew days, depends on Google's crawlers, when the crawl your site ( this alone depends on a few parameters), so I wouldn't worry if I were you, wait a few more days.
    Signature
    {{ DiscussionBoard.errors[8083440].message }}
  • Profile picture of the author jaisonjohn
    It is not mandatory for Google bot to crawl the pages then and there, as there are times when Google bot takes sometime to crawl few of the pages, so you need have to worry. I too have website for which few of the pages are crawled instantly and few later on.
    {{ DiscussionBoard.errors[8083465].message }}
  • Profile picture of the author yukon
    Banned
    Google will increase crawl rate depending how often the site is updated, but it doesn't happen over night, it's more like their algo. gradually increases crawl rate as it learns your posting pattern.
    {{ DiscussionBoard.errors[8083468].message }}
  • Profile picture of the author cbnet
    If that is the case that indexing depends on when google bot crawls my new posts, why then my posts have been getting indexed instantly on publishing them for few past months & delay in indexing of my latest post.
    {{ DiscussionBoard.errors[8083508].message }}
    • Profile picture of the author Andyhenry
      Originally Posted by cbnet View Post

      If that is the case that indexing depends on when google bot crawls my new posts, why then my posts have been getting indexed instantly on publishing them for few past months & delay in indexing of my latest post.
      You need to ask Google. Anyone else is just guessing.

      As was already said - the only way to increase this is to keep adding content and even then Google can change when they index and there's nothing you can do just build more content and get more links - so stop worrying about it and just get busy with your site.
      Signature

      nothing to see here.

      {{ DiscussionBoard.errors[8083515].message }}
    • Profile picture of the author yukon
      Banned
      Originally Posted by cbnet View Post

      If that is the case that indexing depends on when google bot crawls my new posts, why then my posts have been getting indexed instantly on publishing them for few past months & delay in indexing of my latest post.
      If you slow down posting, there's no reason for Google to keep returning as often, did you slow down your posting/updating pages?

      I know for a fact that Google will sometimes, re-index a page If the page is updated, easily tested by making a small edit to the end of an indexed page title then watching the exact URL in the SERPs.

      Example:
      site:domain.com/internal-page-here
      If you really need that new internal page indexed ASAP, make an edit to your Index page <title> to try & get Google bots attention.
      {{ DiscussionBoard.errors[8083530].message }}
      • Profile picture of the author cbnet
        Thanks to all who replied.

        @Yukon:

        I don't understand this:

        "If you really need that new internal page indexed ASAP, make an edit to your Index page <title> to try & get Google bots attention."

        Please advise how to do it.

        BTW, it just got indexed a while ago.
        {{ DiscussionBoard.errors[8083541].message }}
  • Profile picture of the author Andyhenry
    You can use the robots.txt crawl-delay directive to control bot access frequency or in your Google webmaster tools.
    Signature

    nothing to see here.

    {{ DiscussionBoard.errors[8083556].message }}
  • Profile picture of the author jedsonack2
    Did you set robot.txt crawler interval to index....
    If not then google cache is not guaranteed it may cache in one hour or one day or many be one month....
    {{ DiscussionBoard.errors[8083667].message }}
  • Profile picture of the author tech84
    Happened to me too, new posts would get indexed almost if the publish button was also an "index this" button.

    But now since posting new articles are so infrequent new posts get indexed after an hour of so and even sometimes on the next day.

    Its because the crawl rate adjusts to the frequency of new content. If the the crawler visits your site often an notices nothing has changed or changes only every few days or week or so, it will automatically adjust the crawl rate to something more less frequent.
    {{ DiscussionBoard.errors[8083672].message }}

Trending Topics