So how long is Google taking to index pages these days?

19 replies
  • SEO
  • |
Been out of the SEO game for a while. I have now built out a big, database-driven site with tens of thousands of pages, with 5-10,000 more added every day. As soon as I fed Google my sitemap it went crazy on my site (had to limit the crawl rate), and it's been crawling hundreds to thousands of pages every day, so I figure it's found something tasty to munch on, but it's been days of this and not a single page actually in Google's index yet. Any experience of how Google behaves with this kind of site and how long it takes for pages to pop up in the index?
#days #google #index #long #pages #taking
  • Profile picture of the author expmrb
    It takes its own time. No matter how much big number of urls you submit or get crawled still Google will take its own time to index and rank them. It may occur overnight in some cases and in some cases it make take weeks.
    Signature
    SEO Motionz Forum & Blog- Digital Marketing Forum & Blog,
    Forum Management & Promotion, SEO Tips, Money Making tips etc.
    {{ DiscussionBoard.errors[11117545].message }}
    • Profile picture of the author markowe
      Originally Posted by expmrb View Post

      It takes its own time. No matter how much big number of urls you submit or get crawled still Google will take its own time to index and rank them. It may occur overnight in some cases and in some cases it make take weeks.
      Sure, I guess I just have to be patient - it is heavily structured data so I imagine it wants to do some crunching on it, but it would be nice to know whether it's going to index anything, so I can get on and do other stuff . Ah well, Google moves in mysterious ways, nothing has changed there.

      By the way, it's insane just how far ahead of the game Google is as compared to other search engines. It takes Bing days just to lazily download a few sitemaps, never mind crawl anything...
      Signature

      Who says you can't earn money as an eBay affiliate any more? My stats say otherwise

      {{ DiscussionBoard.errors[11117551].message }}
  • Profile picture of the author expmrb
    If you get some quality links to your pages. Then it will get indexed and ranked faster.
    Signature
    SEO Motionz Forum & Blog- Digital Marketing Forum & Blog,
    Forum Management & Promotion, SEO Tips, Money Making tips etc.
    {{ DiscussionBoard.errors[11117585].message }}
  • Profile picture of the author gnojham
    I know for a fact it takes exactly about 350
    {{ DiscussionBoard.errors[11117602].message }}
    • Profile picture of the author markowe
      Originally Posted by gnojham View Post

      I know for a fact it takes exactly about 350
      Brilliant, I am up to 197.5 so far. If I click my links faster will it index faster? /s
      Signature

      Who says you can't earn money as an eBay affiliate any more? My stats say otherwise

      {{ DiscussionBoard.errors[11117609].message }}
      • Profile picture of the author gnojham
        Originally Posted by markowe View Post

        Brilliant, I am up to 197.5 so far. If I click my links faster will it index faster? /s
        Was this a serious question? Of course it will.
        {{ DiscussionBoard.errors[11117617].message }}
  • Profile picture of the author subraasingapore
    Cannot Guess the Time to index!!

    Though having good quality content can make it soon than others!!
    {{ DiscussionBoard.errors[11117670].message }}
    • Profile picture of the author markowe
      Originally Posted by subraasingapore View Post

      Cannot Guess the Time to index!!

      Though having good quality content can make it soon than others!!
      Quality content I think is an extremely subject category. I don't think "quality" is necessarily a factor when Google is initially indexing a site.
      Signature

      Who says you can't earn money as an eBay affiliate any more? My stats say otherwise

      {{ DiscussionBoard.errors[11117824].message }}
  • Profile picture of the author Kay King
    5-10,000 more added every day
    Clearly no human is adding 10k pages a day - and google knows that.

    Google may or may not recognize 'quality' - but often will resist what might appear to be 'manipulation'. Just a guess on my part.
    Signature
    Saving one dog will not change the world - but the world changes forever for that one dog
    ***
    My ducks are absolutely not in a row. I don't even know where some of them are...
    ...and I'm pretty sure one of them is a pigeon.
    {{ DiscussionBoard.errors[11117830].message }}
    • Profile picture of the author markowe
      Originally Posted by Kay King View Post

      Clearly no human is adding 10k pages a day - and google knows that.

      Google may or may not recognize 'quality' - but often will resist what might appear to be 'manipulation'. Just a guess on my part.
      Yes, I am quite mindful of that. On the other hand, not all "quality" content is human-created, and not all mass-produced content is manipulative. How Google decides what is what - well, if we knew that we'd be billionaires
      Signature

      Who says you can't earn money as an eBay affiliate any more? My stats say otherwise

      {{ DiscussionBoard.errors[11117861].message }}
  • Profile picture of the author FloXera
    Try to add you new URL to a famous website (as a signature for example) and in a few hours you should be able to have you website listed.
    Using google webmaster tools can also helps.
    {{ DiscussionBoard.errors[11117889].message }}
  • Profile picture of the author Mattsaas
    Within two weeks your site should be found if you go to Google and search for site:yourURL.com

    It won't be ranking highly, but you should be able to see your pages there. If not, check in Search Console how many pages you have indexed.
    Signature
    MonetizationMethod.com - You don't actually need a tonne of traffic to monetize your blog..
    {{ DiscussionBoard.errors[11118131].message }}
  • Profile picture of the author Abhi71
    We don't know about the crawler time. Just wait for crawler and be patient. As crawler scans all websites , it takes time.
    {{ DiscussionBoard.errors[11118375].message }}
  • Profile picture of the author VincentREpota
    4-5 days. IF u want save time you can take some ping tool... the best is using paid-tool. free tool isn't effective.
    {{ DiscussionBoard.errors[11118637].message }}
  • Profile picture of the author davidricherd
    Google takes approx. 24-48 hours to index a webpage if you have submit it to search engine submission.
    {{ DiscussionBoard.errors[11118810].message }}
  • Profile picture of the author Sisi Marketme
    The same happens with me.. my new site generates almost 100 blogs a day and Google has not indexed even a single page uptil now. Sitemap is huge. Don't know what to do.

    This is my site - http://enjoywebsites.com
    {{ DiscussionBoard.errors[11119094].message }}
  • Profile picture of the author DesignPluz
    Might be it takes minimum 7 days.
    {{ DiscussionBoard.errors[11119110].message }}
  • Profile picture of the author markowe
    Interesting, around 2 weeks now and nothing indexed, crawl rate slowed down a lot as well. I am quite ready for the possibility that Google won't index thousands of pages of my new site, but it must be crawling them for SOME reason, I would expect from experience for at least some pages to be indexed. At the moment it's just the homepage and a couple of sitemaps (yes, two actual sitemaps are in the index, looks buggy, nothing wrong with the site though, Google is using the sitemaps to navigate). I will report back if anything interesting happens.

    EDIT: Oh, so Google DOES index sitemap files apparently: https://www.seroundtable.com/archives/018761.html
    Signature

    Who says you can't earn money as an eBay affiliate any more? My stats say otherwise

    {{ DiscussionBoard.errors[11124211].message }}

Trending Topics