not indexing few urls

9 replies
  • SEO
  • |
hello all,

we have launched a new website 9 months ago it has almost 4000 urls, all the urls were indexed by google but few important urls are not indexed by google. i have done a lot of manual submission for pinging and indexing, still urls are not indexed by google.

in bing few urls were indexed but in google not.
URL : https://goo.gl/kadS8D

these urls are not indexed

complete blog post urls : https://goo.gl/e1lTfx
and complete features tab in menu and sub tabs : https://goo.gl/3GRzkO
#indexing #urls
  • Profile picture of the author alexjames212
    Did you check the crawl tool within the Google Search Console? Look for how the crawlers are indexing your website.
    {{ DiscussionBoard.errors[10972541].message }}
  • Go to Google Search Console>>Crawl>>Fetch as google>> Enter the URL and Click Fetch. This will helps to index URL quicker
    {{ DiscussionBoard.errors[10972652].message }}
  • Profile picture of the author HangTenSEO
    Now that you posted here, they will most likely be indexed.
    {{ DiscussionBoard.errors[10972748].message }}
  • Profile picture of the author michaelkoehler92
    Best would be to let it index on its own as after they get indexed on its own they wont get deindexed
    {{ DiscussionBoard.errors[10972800].message }}
  • Profile picture of the author Shaun Marrs
    Have you tried using any premium indexing tools?
    {{ DiscussionBoard.errors[10973117].message }}
  • Profile picture of the author maheshyeshvanth
    i checked the crawl tool in webmaster tools on 3rd jan the crawl rate is 94 pages crawled, 2565 kilobytes downloaded, 288 millisecounds time spent to download.

    also tried fetch as google many times but no use,

    i have not tried any premium tools just using free pinging tools.
    {{ DiscussionBoard.errors[10974233].message }}
  • Profile picture of the author jackyr
    Go to Google Webmaster Tools >>Crawl >>Fetch as google >> Enter the URL and Click Fetch. This will helps to index URL quick.
    Thanks
    Jacky
    {{ DiscussionBoard.errors[10979639].message }}
  • Profile picture of the author SEOtraveler
    Hey, I have run a quick audit for your website on behalf of Googlebot, and it looks like the pages in question (/blog and /features) are actually Disallowed by x-robots - the pages return the 'X-Robots-Tag:noindex' with the Response Header:



    Which basically instructs crawlers not to index the pages. It`s actually the same for Bingbot, but I cannot see these pages indexed in Bing as well.

    Remove the instructions and then resubmit your sitemap or use the Fetch feature in Google Webmaster Tools, and the URLs should be indexed in a while. Hope this is helpful!
    {{ DiscussionBoard.errors[10979688].message }}
  • Profile picture of the author maheshyeshvanth
    @SEOtraveler : Thanks for your observation and valuable reply, i will try removing that code and get back to you.
    {{ DiscussionBoard.errors[10983357].message }}

Trending Topics