Google not crawling site?

by 27 replies
31
I have a blog which is on Page 1 of Google - everyday I make it a point to post a 500 word article on it. I get the message that the blog was updated (message seen on Google). But since 5 days, though I am still posting 500 word CS approved articles, I am getting no message that the site is updated. It shows that the site was updated 5 days back.

Can someone please let me know what is happening here?

Regards
#search engine optimization #crawling #google #site
  • Google crawl your site at least ones a week.but it is mostly depend on your work and your server IP address.There are so many site available on Google whose Google did not crawl.Thank you for sharing nice post.
    • [1] reply
    • Oh wow...I did not know that G crawls the site once every 7 days. But this is still confusing...how come the site was getting crawled every day since it was launched and it stopped getting crawled since just the past 5 days?

      Thanks but, I appreciate your help.
      Regards
  • You can set your crawl rate within Webmaster Tools.
    Google generally index a new post on a regular blog within a few hours. You can use "site:url" operator to manually check the index status of the post.
    • [1] reply
    • Hmmm am not gud at techhie stuff... but I appreciate your help. Regards
  • Banned
    [DELETED]
    • [1] reply
  • Yes, you can user the Webmaster tools to set the crawl rate. I usually have G decide by itself the frequency and crawl rate rather than me specifying it explicitly.
    • [2] replies
    • You can tell Google to crawl your site by manually entering your post's url in the link. This is best done after you have made your post and wants Google to index it ASAP.

      www (dot) google (dot) com/webmasters/tools/submit-url

      Hope it helps.
      • [1] reply
    • I do not know to do all this, but appreciate you helping me.
      Regards
      • [1] reply
  • Yes, Google crawls sites once a week. If you want your site to be crawled right away you can ping it with pinger tools.
    • [1] reply
    • Hi...read somewhere that it is not good to ping as Google does not like it. So I do not ping. Regards
  • I won't say Google crawls a site only once in a week. Sites like gets crawled almost everyday. Even one of my web properties get crawled twice a week.

    RavishingRajni, there was a problem in Google's cache. It was showing last crawl date of August and for some sites, it was showing this message - "404. That's an error. The requested URL was not found on this server."

    But now it is showing the cache dates. Check again!!
    • [1] reply
  • Banned
    [DELETED]
  • If you have used black hat method to promote your website, it can be cause of send box. In that case you have need to contact with Google employees. If it is not than you have need to verify your website.
    • [1] reply
    • LOL.. do you know what you are suggesting, it doesn't make any sense. rather the OP is having problem with crawling rate not sandboxed.
  • I need to state once again..
    my site has been crawled by Google...
    it is just not being crawled since the past 5 days...
    this is what is confusing me.
    Regards
  • Ahhh...at last...after 6 days..Google crawled the site.
  • Good, but hope you have verified it. If you submit to google webmasters, you will know the crawl rate for the sites you submitted.
  • Doing a few social bookmarks of your new posts can make the crawling/indexing process considerably faster.
  • You can track through google webmaster. As said before do bookmarking in quality sites.
  • Banned
    [DELETED]
  • Google crawls every minute but this is not for new blogs or unreputed websites.
    High authority sites are indexed within minutes.
  • Yes, could be right. But it takes time to get the authority from the SEs. Only way is to wait and be patient for our sites to grow older and gain authority.
  • Another good way to get your site crawled is by generating a sitemap and submitting it to google webmasters. This will also ensure that all your indexed and non-indexed pages are crawled.
  • I don't update my blog often. But I do know a few minutes after posting an article googles bot is online crawling it.

    I'm glad their crawling the site. But it seems kinda creepy, that there right there crawling the article a few minutes after posting. They must be right behind me watching my every move waiting for me to post. XD

    Chad
  • Thats true. Everytime I look at my awstats, I see google bot crawled my site just a few minutes back. May be that our sites are gaining authority on google's eyes which is why they are hot on our track.
Join the discussion

Next Topics on Trending Feed

  • 31

    Google not crawling site?

    I have a blog which is on Page 1 of Google - everyday I make it a point to post a 500 word article on it. I get the message that the blog was updated (message seen on Google). But since 5 days, though I am still posting 500 word CS approved articles, I am getting no message that the site is updated. It shows that the site was updated 5 days back. Can someone please let me know what is happening here?