WHy sitemap is not indexing ALL pages ??

14 replies
  • SEO
  • |
I just watched a Howie Schwatz video where he shows all his 1200 pages of a brand new blog indexed already in Google via sitemap. My site has over 2000 pages but only 500 are indexed in Google via: "site:http://www.cvtreasures.com" (without the quotes)

Is there a tool to get al pages indexed? Can Google Webmaster export a list of URLs for my site so I can manually PING them ?? Any other ideas?
#indexing #pages #sitemap
  • Profile picture of the author AFD
    Hard to answer but I think google select only quality pages... If you have wordpress blog, include tag pages on your sitemap..
    {{ DiscussionBoard.errors[1813913].message }}
  • Profile picture of the author bigcat1967
    It does take a while to get a mega site fully indexed - how long have you been up?
    Signature

    <a href="https://changeyourbudget.com/save-money-on-your-water-bill/">How to Lower Your Water Bill</a>

    {{ DiscussionBoard.errors[1813970].message }}
    • Profile picture of the author nofearman
      Site? ABout 5 years.
      Sitemap? ABout 6-8 months


      Originally Posted by bigcat1967 View Post

      It does take a while to get a mega site fully indexed - how long have you been up?
      {{ DiscussionBoard.errors[1815823].message }}
  • Profile picture of the author MikevanderHeijden
    nofearman - have you submitted a XML sitemap to Google Webmaster Tools, this usually aids in speeding up the spidering of your site.
    {{ DiscussionBoard.errors[1814020].message }}
    • Profile picture of the author nofearman
      Originally Posted by MikevanderHeijden View Post

      nofearman - have you submitted a XML sitemap to Google Webmaster Tools, this usually aids in speeding up the spidering of your site.
      Yes, about 6-8 months ago. 500 pages (out of about 2100) are indexed. BUT, as mentioend above, HOW do I get all 2100 indexed? As
      "Site: website" only says about 500
      {{ DiscussionBoard.errors[1815829].message }}
  • Profile picture of the author bgmacaw
    Build links to your deep internal pages like...

    Confessions of a Nazi Spy Title Card

    The Golden Stallion Movie Poster

    Googlebot has a limiter on it that helps it avoid 'bot capture sites that were popular a few years ago. If your inner pages don't have links to them, the 'bot may never dig deep enough to find them, even with a sitemap. By having inbound links at the lower level, you encourage inside-out spidering of your site rather than top down starting at the index page. If done right you can even get double listings in search results when you do this.
    {{ DiscussionBoard.errors[1814065].message }}
    • Profile picture of the author Bruce Hearder
      Also, Google doensn't like to read pages with more than 99 links on them.. YES sitemaps as well.. The smaller the sitemap is, the faster the pages are indexed..

      Read more about it here..

      http://www.google.com/support/webmas...n&answer=35769

      http://www.mattcutts.com/blog/how-many-links-per-page/

      So if your site has heaps of pages then you are gonna have to break up the sitemap into multiple sitemaps files. You will need to deal with sitemap indexes

      Read more about sitemap indexes here..

      http://www.sitemaps.org/protocol.php#index

      The standard WP plugins make HUGE sitemaps that are not really all that usefull..

      You will need to find some specific plugins or get some custom code written to achieve this..

      Maybe Howie has got some different sitemap plugin running on his blog.. Who knows..

      Hope this helps

      Bruce
      {{ DiscussionBoard.errors[1814388].message }}
    • Profile picture of the author nofearman
      Originally Posted by bgmacaw View Post

      Build links to your deep internal pages like...

      Confessions of a Nazi Spy Title Card

      The Golden Stallion Movie Poster

      Googlebot has a limiter on it that helps it avoid 'bot capture sites that were popular a few years ago. If your inner pages don't have links to them, the 'bot may never dig deep enough to find them, even with a sitemap. By having inbound links at the lower level, you encourage inside-out spidering of your site rather than top down starting at the index page. If done right you can even get double listings in search results when you do this.
      This makes sense, Thanks!

      P.S. "If done right you can even get double listings in search results when you do this. "... Can you offer some further ideas for "double listings"? I have struggled to ge these for past few years with some, but limited success.
      {{ DiscussionBoard.errors[1815834].message }}
      • Profile picture of the author bgmacaw
        Originally Posted by nofearman View Post

        "If done right you can even get double listings in search results when you do this. "... Can you offer some further ideas for "double listings"? I have struggled to ge these for past few years with some, but limited success.
        The basic technique is to have two pages on your site linked together using a common keyword.

        For example, the "Golden Stallion Movie Poster" page might link to other Roy Rogers themed pages using "Roy Rogers Movie Posters" as the keyword anchor and vice versa. On a blog this is usually done by having a related posts plugin. I don't know how this would work on ZenCart but there is probably some way to set this up.

        The 'secret sauce' of the formula is that both pages have to be indexed and have incoming links from other sites that fully or partially match the keyword being searched for. If your site has some authority for the niche, this also helps. There's no guarantee that you'll get the double listing but having this in place helps. You might also get the double listing without the inbound links, I have sometimes, but having the links seems to help matters a lot.
        {{ DiscussionBoard.errors[1815913].message }}
        • Profile picture of the author nofearman
          Originally Posted by bgmacaw View Post

          The basic technique is to have two pages on your site linked together using a common keyword.

          For example, the "Golden Stallion Movie Poster" page might link to other Roy Rogers themed pages using "Roy Rogers Movie Posters" as the keyword anchor and vice versa. On a blog this is usually done by having a related posts plugin. I don't know how this would work on ZenCart but there is probably some way to set this up.

          The 'secret sauce' of the formula is that both pages have to be indexed and have incoming links from other sites that fully or partially match the keyword being searched for. If your site has some authority for the niche, this also helps. There's no guarantee that you'll get the double listing but having this in place helps. You might also get the double listing without the inbound links, I have sometimes, but having the links seems to help matters a lot.
          The one major issue I had with this before (when first learning it from Stompernet) was how to have a Home Page/Sub Page double listigns without flooded the home page with internal links.
          {{ DiscussionBoard.errors[1833940].message }}
  • Profile picture of the author siliwangitravel
    maybe gives high PR backlink on every pages, it could get index faster : )
    {{ DiscussionBoard.errors[1814542].message }}
  • Profile picture of the author ovaismirza
    Banned
    [DELETED]
    {{ DiscussionBoard.errors[1814787].message }}
    • Profile picture of the author nofearman
      Originally Posted by ovaismirza View Post

      Once the pages are indexed in google and other major search engines ..then it will be appear in your xml sitemap also..the other thing may be that all the sitemap generators available on the net indexing only 500 pages if you are using it for free...if you do have more than 500 pages then they are paid..

      HI,

      Not quite sure about -> "sitemap generators available on the net indexing only 500 pages if you are using it for free...if you do have more than 500 pages then they are paid."... Can you elaborate?
      {{ DiscussionBoard.errors[1815850].message }}
  • Profile picture of the author mcain
    yes it would be good to have pages in order down page
    {{ DiscussionBoard.errors[1838815].message }}
  • Profile picture of the author WebTronics
    You need to increase your ranking by increasing your backlinks.
    {{ DiscussionBoard.errors[1839817].message }}

Trending Topics