Delete please

by Kory Pearman 4 replies
Old thread
#main internet marketing discussion forum #google #hour #record #result #timeless
Avatar of Unregistered
  • Profile picture of the author Michael Dominic
    It all depends on how often Google crawls that particular site. I've seen reports of sites getting crawled 200 times a day. Some are only once a week or a couple times a month!

    If Google sees your website is being updated they will crawl it more often. You can also specify how often you want to be crawled in your robots.txt file. There's also options in Google Webmaster Tools.

    http://www.google.com/webmasters/tools/
    {{ DiscussionBoard.errors[151126].message }}
    • Profile picture of the author Sean A McAlister
      Originally Posted by Michael Dominic View Post

      It all depends on how often Google crawls that particular site. I've seen reports of sites getting crawled 200 times a day. Some are only once a week or a couple times a month!

      If Google sees your website is being updated they will crawl it more often. You can also specify how often you want to be crawled in your robots.txt file. There's also options in Google Webmaster Tools.

      http://www.google.com/webmasters/tools/

      That's a great piece of info...what is the language that needs to be written for the x times you want your site crawled? Any amount of specific times that you recommend?

      Thanks
      Signature
      New Product Launches, Affiliate Marketplace

      Need More Sales? More Affiliates? LaunchBoards.com
      {{ DiscussionBoard.errors[151132].message }}
      • Profile picture of the author Michael Dominic
        Originally Posted by The IM Reporter View Post

        That's a great piece of info...what is the language that needs to be written for the x times you want your site crawled? Any amount of specific times that you recommend?

        Thanks
        Search for "robots.txt". This file controls and allows customizable values to control how the search engines crawl your site, webpages, a particular file or webpage, etc...

        I just leave it up to the search engines crawl whenever they very well please.
        {{ DiscussionBoard.errors[151143].message }}
  • Profile picture of the author George Wright
    Does this count?

    "your blog on google within minutes" "your blog on google within minutes" - Google Search
    Signature
    "The first chapter sells the book; the last chapter sells the next book." Mickey Spillane
    {{ DiscussionBoard.errors[151139].message }}
Avatar of Unregistered

Trending Topics