12 {{ upvoteCount | shortNum }}
12 {{ upvoteCount | shortNum }}

Anyone have experience with large sites (50,000 pages+)

by TZ
10 replies
  • SEO
    • |
I have two questions about big sites.

So for an experiment last November I wrote a program that publishes a 1200 word Wordpress post every 5 minutes. The program data from spread sheets containing business information scraped for Yellow pages, and other list data creating 67 different variables.

Each 1200 word post is testing in Copyscape at 40%-60% unique so G has cached and indexed every last page it gets around to. There is 37,000 pages on the domain now, and the traffic last week spiked up to 400 unique a day. The content is in an extremely competitive niche so this is a success for sure.....but.

Linking structure is;

Home --> 2nd level --> post

Every post has a link back to 2nd menu and home page and 20 "related posts" links feeding G juice internally.

Question 1#: after G has indexed all the pages and counted the link juice will the traffic take another large bump up?

Question 2#: do large sites that have 80K-90K pages indexed with around 50% unique per page have a real advantage with G?

Have no idea what to expect as the largest site we've run in the past had 350 unique posts.

TZ
#experience #large #pages #sites
  • Profile picture of the author ventureprofits
    It matters what pages you have. Are they well optimized etc? I had an client that had me build like 1k pages (quite a lot actually,when you get into the on-site) and Google ended up indexing all pages.

    Here is my advice:

    1. build posts instead of pages. It just shows more activeness rather than targeting a keyword per/ page.

    2. You don't need a page for every keyword (that is, if you are doing this). There are techniques that you can use in order to get 5 keywords (diff. KW's) that point to same page in SERPs.

    -Ben
    Signature
    Want ASM 2014? contact me
    {{ DiscussionBoard.errors[9085402].message }}
    • Profile picture of the author TZ
      Originally Posted by ventureprofits View Post

      It matters what pages you have. Are they well optimized etc? I had an client that had me build like 1k pages (quite a lot actually,when you get into the on-site) and Google ended up indexing all pages.

      Here is my advice:

      1. build posts instead of pages. It just shows more activeness rather than targeting a keyword per/ page.

      2. You don't need a page for every keyword (that is, if you are doing this). There are techniques that you can use in order to get 5 keywords (diff. KW's) that point to same page in SERPs.

      -Ben
      I should have said posts - they're all posts (not Wordpress pages)

      About 10-12 keywords are well optimized each post - that's why the traffic

      I'm most curious about the link juice a 50,000+ page site creates with the content described above. 50% unique 1200 words.

      TZ
      Signature

      $php_coding = "consistent cash";

      echo ("Give me" . " " . $php_coding . "!");

      {{ DiscussionBoard.errors[9085463].message }}
      • Profile picture of the author ventureprofits
        Originally Posted by TZ View Post

        I should have said posts - they're all posts (not Wordpress pages)

        About 10-12 keywords are well optimized each post - that's why the traffic

        I'm most curious about the link juice a 50,000+ page site creates with the content described above. 50% unique 1200 words.

        TZ
        I am assuming the 50k pages is probably some ecommerce site (maybe not if it has posts instead of pages, but you can actually use either).

        If 50k posts were released slowly over a year, then it would DEFINITELY be a good sign to Google's eyes.

        I would conclude that it wouldn't really make a different between a 50-100 post website vs. a 50k page.

        If both have authoritative link backup and other necessary SEO factors, then the website should be ranked without issue at all.

        -Ben
        Signature
        Want ASM 2014? contact me
        {{ DiscussionBoard.errors[9085833].message }}
        • Profile picture of the author nik0
          Banned
          Indexing is never really the problem.

          You can get the worse scraped sites, barely spun at word level, indexed in Google.

          The rankings are the problem, however you did something well I suppose if you got to 400 unqiue visitors/day.

          Don't expect another bump just because all the posts are indexed now, if there are no back links then there is no juice. You can obvious argue that each new page has a tiny bit of juice (cause where else would link juice come from in the first place of course, chicken/egg story), but that would be like 0,000001 PR and even with 50k pages that won't make much of an impact.
          {{ DiscussionBoard.errors[9085881].message }}
          • Profile picture of the author TZ
            Originally Posted by nik0 View Post

            Indexing is never really the problem.

            You can get the worse scraped sites, barely spun at word level, indexed in Google.

            The rankings are the problem, however you did something well I suppose if you got to 400 unqiue visitors/day.

            Don't expect another bump just because all the posts are indexed now, if there are no back links then there is no juice. You can obvious argue that each new page has a tiny bit of juice (cause where else would link juice come from in the first place of course, chicken/egg story), but that would be like 0,000001 PR and even with 50k pages that won't make much of an impact.
            Thanks Nik - that is what I assumed - even if every post was unique in the eyes of Google, the juice each post created would be very slight. Unless like Venture said there was authority links hitting some of these posts.

            Other question then is what is considered TOO fast in Google's eyes. I'm posting 288 posts every 24 hours. One every 5 minutes.
            Signature

            $php_coding = "consistent cash";

            echo ("Give me" . " " . $php_coding . "!");

            {{ DiscussionBoard.errors[9087201].message }}
          • Profile picture of the author ventureprofits
            Originally Posted by nik0 View Post

            Indexing is never really the problem.

            You can get the worse scraped sites, barely spun at word level, indexed in Google.

            The rankings are the problem, however you did something well I suppose if you got to 400 unqiue visitors/day.

            Don't expect another bump just because all the posts are indexed now, if there are no back links then there is no juice. You can obvious argue that each new page has a tiny bit of juice (cause where else would link juice come from in the first place of course, chicken/egg story), but that would be like 0,000001 PR and even with 50k pages that won't make much of an impact.
            I think the 400 per day could also come from long tail keywords that his posts end up ranking for.
            Signature
            Want ASM 2014? contact me
            {{ DiscussionBoard.errors[9087693].message }}
            • Profile picture of the author nik0
              Banned
              Originally Posted by ventureprofits View Post

              I think the 400 per day could also come from long tail keywords that his posts end up ranking for.
              I am pretty sure about that but I've had sites with 50k scraped/spun pages myself and they drove only like 20 visitors/day.
              {{ DiscussionBoard.errors[9088302].message }}
  • Profile picture of the author Big Kahuna SEO
    I have a site with 99,000+ posts largely duplicate content. No issues at all with getting indexed and I receive more than 1500 visitors per day. Those posts were built over the period of 2 months so to answer your question, I don't think it matters at all how quickly they are built. By the way, the site has been live for more than 3 years without issue. Haven't added a post or another piece of content since.
    {{ DiscussionBoard.errors[9088363].message }}
    • Profile picture of the author ronackman
      To take this to the extreme, I have a site with nearly 20 million indexed pages. It gets ~15k visitors a day. Definitely long tail since I haven't done any off-site SEO. The site is a couple of years old and it launched with all of those pages in place although improvements to the structure and URLs have been made over time. I actually was not trying to monetize the site when I created it...got distracted by another project and came back a year later to see decent traffic so I put in ads and now it's a good passive income source. I have no clue how you'd boost overall SERPs for so many pages but there is definitely still an opportunity in filling long tail gaps.
      {{ DiscussionBoard.errors[9088506].message }}
      • Profile picture of the author ventureprofits
        Originally Posted by ronackman View Post

        To take this to the extreme, I have a site with nearly 20 million indexed pages. It gets ~15k visitors a day. Definitely long tail since I haven't done any off-site SEO. The site is a couple of years old and it launched with all of those pages in place although improvements to the structure and URLs have been made over time. I actually was not trying to monetize the site when I created it...got distracted by another project and came back a year later to see decent traffic so I put in ads and now it's a good passive income source. I have no clue how you'd boost overall SERPs for so many pages but there is definitely still an opportunity in filling long tail gaps.
        If you are using WP, you can use Yoast to bulk edit titles (there's an awesome option for that)

        however, if it's longtail, I wouldn't worry about it. I would advice to silo all those small suckers to point to home or have home point to the small ones. There are many options
        Signature
        Want ASM 2014? contact me
        {{ DiscussionBoard.errors[9088903].message }}

Trending Topics