Only a small percentage of websites get indexed
I found this snippet and thought it was interesting. I had no idea that so little of what is on the internet is actually indexed. I keep seeing people suggest that you can just make backlinks and the search engines will eventually find them but in my experience this is false. I purchased 200 forum profile backlinks in December of 2009 and then forgot about them. I recently looked and 149 of those links are still active but only 12 were showing up as indexed.
Here it is:
How Much of the Web is Indexed by Search Engines? (Excerpt from Search Engine Marketing Inc)
It sounds easy. Spiders visit the pages and send them to the search index. Those little spiders keep crawling until they index the entire Web, right? Wrong. The truth is that the great majority of Web pages are not indexed in search engines. Over the years, there have been many estimates of the gap between the number of indexed pages and all Web pages. In 1999, Lawrence and Giles found that the (now defunct) Northern Light search engine indexed just 16 percent of the estimated 800 million publicly available Web pages (Searching the World Wide Web by Steve Lawrence and C. Lee Giles, 1999). But the next year, Michael Dahn claimed the problem might be twice as bad as reported, because the "publicly available" Web may underestimate the total Web by half (Counting Angels on a Pinhead: Critically Interpreting Web Size Estimates by Michael Dahn, 2000).
Not to be outdone, in 2001 two studies estimated the total number of Web pages to be far larger than previously reported. Sherman and Price proclaimed the "Invisible Web is between 2 and 50 times larger than the visible Web" (The Invisible Web by Chris Sherman and Gary Price, p. 82, 2001). In Deep Content: Surfacing Hidden Value (BrightPlanet, 2001), Michael Bergman posited the Web contains 550 billion pages and search engines see only 0.03 percent of them.
Regardless of the wildly divergent numbers, the point is that an enormous number of pages are not indexed, and your Web site probably contains some of them. Each page on your site that is not indexed is completely invisible to searchers, which reduces traffic to your site, so your goal is to get as many indexed as possible.
Here it is:
How Much of the Web is Indexed by Search Engines? (Excerpt from Search Engine Marketing Inc)
It sounds easy. Spiders visit the pages and send them to the search index. Those little spiders keep crawling until they index the entire Web, right? Wrong. The truth is that the great majority of Web pages are not indexed in search engines. Over the years, there have been many estimates of the gap between the number of indexed pages and all Web pages. In 1999, Lawrence and Giles found that the (now defunct) Northern Light search engine indexed just 16 percent of the estimated 800 million publicly available Web pages (Searching the World Wide Web by Steve Lawrence and C. Lee Giles, 1999). But the next year, Michael Dahn claimed the problem might be twice as bad as reported, because the "publicly available" Web may underestimate the total Web by half (Counting Angels on a Pinhead: Critically Interpreting Web Size Estimates by Michael Dahn, 2000).
Not to be outdone, in 2001 two studies estimated the total number of Web pages to be far larger than previously reported. Sherman and Price proclaimed the "Invisible Web is between 2 and 50 times larger than the visible Web" (The Invisible Web by Chris Sherman and Gary Price, p. 82, 2001). In Deep Content: Surfacing Hidden Value (BrightPlanet, 2001), Michael Bergman posited the Web contains 550 billion pages and search engines see only 0.03 percent of them.
Regardless of the wildly divergent numbers, the point is that an enormous number of pages are not indexed, and your Web site probably contains some of them. Each page on your site that is not indexed is completely invisible to searchers, which reduces traffic to your site, so your goal is to get as many indexed as possible.
-
King Shiloh Banned-
Thanks - 1 reply
{{ DiscussionBoard.errors[2788144].message }}-
Bill Farnham -
Thanks
Signature
{{ DiscussionBoard.errors[2788174].message }} -
-
-
Kael41 -
[ 1 ] Thanks - 1 reply
{{ DiscussionBoard.errors[2788426].message }}-
4morereferrals -
Thanks
SignatureRank Ascend Network - High PR Links / Guaranteed Rankings Increase{{ DiscussionBoard.errors[2788728].message }} -
-