Only a small percentage of websites get indexed

by 4 replies
6
I found this snippet and thought it was interesting. I had no idea that so little of what is on the internet is actually indexed. I keep seeing people suggest that you can just make backlinks and the search engines will eventually find them but in my experience this is false. I purchased 200 forum profile backlinks in December of 2009 and then forgot about them. I recently looked and 149 of those links are still active but only 12 were showing up as indexed.

Here it is:



#main internet marketing discussion forum #indexed #percentage #small #websites
  • Banned
    This is shocking! So, we are wasting our energy and time?
    • [1] reply
    • Apparently, and quite often it seems...:rolleyes:

      ~Bill
  • No, this isn't shocking. If you're an old time SEO guy, then you remember the days of following the Inktomi spiders and wondering if your pages were going to be included in yahoo

    There is a rhyme and reason as to how the bots and spiders see your pages, and then include them into one of their indexes. The illustration of profile backlinks is a great example. Just because you build something, it doesn't mean the S.E's will find it. Google has always touted page/link structure on a webpage to maximize the googlebot's abiltiy to see your site and thus index it. You ever wonder why sitemaps are so powerful? Because it gives the spiders and bots an entry and flow point through your whole site...

    Now, given that you build out a deep profile link, it's a no-brainer why these little links do NOT get recognized most of the time. Set and forget deep and profile links rarely work anymore. You need to give the bots and spiders a way into those links to allow those links to be registered from an index perspective.
    • [ 1 ] Thanks
    • [1] reply
    • Yes sir indeedy ...

      I and anther warrior did a pretty good control group study on this very issue - and then set about to create the solution - and I feel we have accomplished that mission.

      We found that its not just the lowly forum profile links that get left to rot by our friendly Google Bot. In fact our testing indicates that even the vaunted Wordpress blog posts - once they roll off that uber PR home page of yours/someone's blog - get tossed aside... on the article networks ...

      think - UAW - SEO Linkvine - Linkvana et al ...

      Whats even worse about the blog posts issue is - your site gets a rapid influx of backlinks from these Article Dir content type sites - 15 minutes after your post gets posted - then their hordes of other customers posts hot the front page - you roll off the all important page one, into the blogs archives etc.

      G Bot or Yahoo SLERP goes back to see if the url still exists where it found your links on the homepages initiall - and oooops - theyre not there any longer. RAPID LINK DECAY and those are now removed from your backlink profile just as fast as they got put in. And that quite frankly - sucks worse than if google never saw them to begin with.

      Wrote a 3 part email series on this to my VIP's - it was pretty popular. People love screen shots and colorful graphs as well as a Backlinkers Funniest Screenshots :-) The Good The Bad and The Ugly. Im re writing the report this morning - into a less detailed quick over-view type report. FREE of course ... Called The UgLY Truth About Your Backlinks.

      We followed 2 controlled groups of backlinks on profiles and blogs 150 links each and studied their indexation rates and departure from the index for 21 days total - and even though I thought I knew there would be a significant difference in the indexed/cached results between doing nothing and "super-uber-topic-secret-automated-processes" - we were pretty blown away at what Google Bot is and isn't doing, as well as how G Bot responds to certain "stimuli" ...

      > 80% of links tested - left to be found naturally by G Bot - never were [ if we gauge that by whats cached in their index ]

      1/2 of these links were on Optimized WP Blogs too - not just "spammy" forum profiles.
Join the discussion

Next Topics on Trending Feed

  • 6

    Only a small percentage of websites get indexed

    I found this snippet and thought it was interesting. I had no idea that so little of what is on the internet is actually indexed. I keep seeing people suggest that you can just make backlinks and the search engines will eventually find them but in my experience this is false. I purchased 200 forum profile backlinks in December of 2009 and then forgot about them. I recently looked and 149 of those links are still active but only 12 were showing up as indexed. Here it is: