Why Is Google Not Indexing My Site?

by Paleus
28 replies
  • SEO
  • |


Since moving back to my main domain, Google is not properly indexing my site. I am getting almost no search engine traffic and I'm not sure why!

I have used 'fetch as Google' for both desktop and smartphone, and yet nothing seems to change.

Regularly, I am getting links from other publications in the industry. I simply have no idea why nothing is being indexed!

Please help, willing to pay bitcoin for an SEO expert.
#google #indexing #site
  • Profile picture of the author johnniewalk
    Banned
    Check while doing fetch as google it confirmed your index or not
    {{ DiscussionBoard.errors[10229180].message }}
  • Profile picture of the author nettiapina
    Is the site the one in your sig? It's often a wrong setting somewhere which is why it's best to take a peek at the site.
    Signature
    Links in signature will not help your SEO. Not on this site, and not on any other forum.
    Who told me this? An ex Google web spam engineer.

    What's your excuse?
    {{ DiscussionBoard.errors[10229184].message }}
  • Profile picture of the author gsminds
    To check out the problem, first you have to identify is there any crawling issue in Google webmaster tools and check is there any error from crawling. The crawling error can be due to robots.txt, .hta access, sitemap, url parameters, meta tags, and etc..

    You may use some rank checker tools to run a website checkup. If all these doesn't resolve your problem, try contact Google support team to see what happen!
    {{ DiscussionBoard.errors[10229488].message }}
  • Profile picture of the author Mehwish84
    check your sitemap and robot.txt file properly then Fetch as google again
    {{ DiscussionBoard.errors[10229699].message }}
  • Profile picture of the author AskAnAffiliate
    Hi,

    There are a few reasons why Google might not be indexing your website.

    First, they might be fresh links and from my experience it takes about 3 months for Google to index your links. There are other factors which will determine this like how new, old or reputable your site is. Secondly, you have not set it up correctly within GWT so I would check for errors.

    1. Is your sitemap.xml ready and accessible?
    2. Is your robots.txt accessible?

    Third, you have to remember about the Google freshness update which will give priority to those sites updating content regularly. This means publishing new content, updating old or linking from other updated content to your page. With that said, the quality of links matter and mix anchor text.

    To be honest it's a hit or miss so don't be too concerned with indexing and focus more on keeping your focus. I'm actually writing a case study on indexing which I'll have published when I get back from my trip.

    Thx
    {{ DiscussionBoard.errors[10229755].message }}
    • Profile picture of the author tami9191
      Originally Posted by AskAnAffiliate View Post

      Hi,

      There are a few reasons why Google might not be indexing your website.

      First, they might be fresh links and from my experience it takes about 3 months for Google to index your links. There are other factors which will determine this like how new, old or reputable your site is. Secondly, you have not set it up correctly within GWT so I would check for errors.

      1. Is your sitemap.xml ready and accessible?
      2. Is your robots.txt accessible?

      Third, you have to remember about the Google freshness update which will give priority to those sites updating content regularly. This means publishing new content, updating old or linking from other updated content to your page. With that said, the quality of links matter and mix anchor text.

      To be honest it's a hit or miss so don't be too concerned with indexing and focus more on keeping your focus. I'm actually writing a case study on indexing which I'll have published when I get back from my trip.

      Thx
      Very useful information thanks
      Signature

      Tamil arasan - https://genuineonlinefreejobs.com/. Thanks you.

      {{ DiscussionBoard.errors[10231172].message }}
      • Profile picture of the author jackluter
        Banned
        The problem may be in the meta tag or robots.txt and check your sitemap regularly and follow web master guidelines properly.
        {{ DiscussionBoard.errors[10231199].message }}
  • Profile picture of the author Paleus
    Thanks for the responses thus far guys. Here are a few things I've tried so far:

    - removed a plugin that was causing redirects
    - reset my robots.txt to default
    - resubmitted my sitemap.xml
    - adding www website version to Google Webmasters (I use non-www)

    Currently looking into:

    - increasing site speed
    - almost all of my links use rel="nofollow" unless they are internal pointing (ie. to my own site, no external links to other sites are followed)



    If you would like to look at the HTML markup, the site is www.diginomics.com
    Signature
    www.diginomics.com - bitcoin research, news, & analysis
    {{ DiscussionBoard.errors[10230013].message }}
  • Profile picture of the author AskAnAffiliate
    Hey,

    Can you try accessing your robots.txt by going to www.yourdomain.com/robots.txt and check what is allowed and/or disallowed.

    Can you please post results here.
    {{ DiscussionBoard.errors[10230058].message }}
    • Profile picture of the author Paleus
      Originally Posted by AskAnAffiliate View Post

      Hey,

      Can you try accessing your robots.txt by going to www.yourdomain.com/robots.txt and check what is allowed and/or disallowed.

      Can you please post results here.
      User-agent: *
      Disallow: /wp-admin/
      Disallow: /wp-includes/
      Disallow: /xmlrpc.php
      Signature
      www.diginomics.com - bitcoin research, news, & analysis
      {{ DiscussionBoard.errors[10230142].message }}
  • Profile picture of the author AskAnAffiliate
    Ok looks good.

    Now it's also important to note that increase in ranks and indexing are two different things. If you are simply not seeing a new link point to your site then that's because Google hasn't picked up that new link. This means Google has not indexed the other website for whatever reason. I suggest you continue to write content and build links.

    As mentioned new links tend to take "3" months to appear from what I have noticed when building PBN's, etc. I've noticed when I build a link it doesn't matter what I do on my end because the indexing of links etc will depend on the site point to me. The other site must make sure they are doing whatever to increase rate of indexing like content, updating and building links. In my case study I have constantly updated my sites and this has helped all links and pages get indexed. I'm even talking about "target" site and those build in my PBN.

    Hope this helps.
    {{ DiscussionBoard.errors[10230177].message }}
  • Profile picture of the author tbsnetworks
    I think You have an error on your robots.txt file
    {{ DiscussionBoard.errors[10231018].message }}
    • Profile picture of the author DavidM@123
      Hi Dear please check your head tag may be you have used noindex meta tag in your page like:<meta name="robots" content="noindex, nofollow"/>
      {{ DiscussionBoard.errors[10231089].message }}
      • Profile picture of the author savidge4
        uh kids... you cant block those directories /wp-admin/ and /wp-includes/

        for reference: https://yoast.com/wordpress-robots-txt-example/

        A lot of this stuff you are trying to block? has already been done for you in much more effective ways. < shakes head >
        Signature
        Success is an ACT not an idea
        {{ DiscussionBoard.errors[10231143].message }}
        • Profile picture of the author TDogger
          Originally Posted by savidge4 View Post

          uh kids... you cant block those directories /wp-admin/ and /wp-includes/
          Pages and scripts in those two directories should NEVER show up in search results, although sometimes they do if you use the Chrome browser. Chrome is spyware. Neither of those two directories includes any pages or web objects that search engines need to view. They therefore can always be blocked. Google does not want you to block /wp-content/, which is where the Media Library, themes and plugins reside.

          The proper way to see what Google is indexing is to use the site: query operator. For example, when I enter site:site:diginomics.com in a Google search box, it tells me that 888 pages have been indexed. However, I also see that very few have properly constructed HTML title tags. If the problem is with a different site, try the site: query operator with that domain name.

          There is a big difference today between getting indexed and ranking well and getting traffic. If the main domain was penalized by Penguin for too many bad backlinks, the only way to resolve that is to fix the problem by removing the poor quality backlinks. Also, penalties remain with domains, even after they have expired. Parking a domain for a while or letting it expire and then registering it again does not resolve a penalty issue.

          http://www.tech-evangelist.com/2014/...-domain-names/

          A #1 rank position for a search phrase that no one uses in a search will never drive traffic. Make sure the site topics are focused on keywords that people actually use in a search.

          Originally Posted by Paleus View Post

          Apparently, Google webmasters recognized HTTP/HTTPS protocol as a site distinction.

          Therefore, I have added HTTP, HTTPS, AND WWW as a property in Google Webmasters Tools.

          Seeing if this will make a difference.
          Your site should resolve to one and only one version of each URL. If the pages resolve to multiple version of each URL, you will have problems.

          Encrypting entire sites using https is the stupidest idea I've ever heard of from Google engineers. Multiple studies have shown that this currently has zero effect on boosting rankings.
          {{ DiscussionBoard.errors[10236044].message }}
  • Profile picture of the author DavidM@123
    Read carefully what type suggestion I have given, I suggested do not use this tag: <meta name="robots" content="noindex, nofollow"/>
    {{ DiscussionBoard.errors[10231158].message }}
  • Profile picture of the author tami9191
    There could by a problem with the sitemap url you've submitted and improper robot.txt file. You should've added your site only after purchasing a domain. One of my friend faces the same problem.
    Signature

    Tamil arasan - https://genuineonlinefreejobs.com/. Thanks you.

    {{ DiscussionBoard.errors[10231169].message }}
  • Profile picture of the author davidweb09
    I think you have used no-index for your site. please check your site code.
    {{ DiscussionBoard.errors[10231213].message }}
  • Profile picture of the author Paleus
    My robots.txt if fine. There is also no meta tag in the head of my pages for nofollow or noindex.

    Still searching for an answer ...

    I'm working on updating the site speed currently. Hopefully something starts happening. If you would like to view the source of the page, the site is Diginomics - Thought Leadership In The Digital Economy.
    Signature
    www.diginomics.com - bitcoin research, news, & analysis
    {{ DiscussionBoard.errors[10232040].message }}
    • Profile picture of the author yukon
      Banned
      Originally Posted by Paleus View Post

      Still searching for an answer ...
      I sent you a PM.
      {{ DiscussionBoard.errors[10232109].message }}
  • Profile picture of the author Paleus
    Could adding HTTPS SSL implementation cause this in some cases? I'm really confused.

    Is there a way to check if your domain has been penalized by Google?
    Signature
    www.diginomics.com - bitcoin research, news, & analysis
    {{ DiscussionBoard.errors[10232162].message }}
    • Profile picture of the author savidge4
      Originally Posted by Paleus View Post

      Could adding HTTPS SSL implementation cause this in some cases? I'm really confused.

      Is there a way to check if your domain has been penalized by Google?

      Oh by the way.. I changed the link structure to my site... twirling your girly long hair.. could that be it?


      Your Analytics data is showing for the HTTP site and NOT the HTTPS site. No more http.. so YES your visit data will drop off the face of the earth.
      Signature
      Success is an ACT not an idea
      {{ DiscussionBoard.errors[10232316].message }}
      • Profile picture of the author Paleus
        Originally Posted by savidge4 View Post

        Oh by the way.. I changed the link structure to my site... twirling your girly long hair.. could that be it?


        Your Analytics data is showing for the HTTP site and NOT the HTTPS site. No more http.. so YES your visit data will drop off the face of the earth.
        Every option for choosing HTTPS over HTTP in both Analytics and Webmaster I have done so.
        Signature
        www.diginomics.com - bitcoin research, news, & analysis
        {{ DiscussionBoard.errors[10232390].message }}
  • Profile picture of the author Paleus
    Apparently, Google webmasters recognized HTTP/HTTPS protocol as a site distinction.

    Therefore, I have added HTTP, HTTPS, AND WWW as a property in Google Webmasters Tools.

    Seeing if this will make a difference.
    Signature
    www.diginomics.com - bitcoin research, news, & analysis
    {{ DiscussionBoard.errors[10232461].message }}
    • Profile picture of the author nettiapina
      Originally Posted by Paleus View Post

      Apparently, Google webmasters recognized HTTP/HTTPS protocol as a site distinction.
      Why wouldn't they? Technically speaking https and http are not necessarily the same site. Different ports and all.
      Signature
      Links in signature will not help your SEO. Not on this site, and not on any other forum.
      Who told me this? An ex Google web spam engineer.

      What's your excuse?
      {{ DiscussionBoard.errors[10233148].message }}
  • Profile picture of the author Exfilius
    There's an http and an https version of your site existing at the same time. The http one needs to redirect to the https version.

    A link pointing to an http page will not carry it's linkjuice to the page's https version unless there's a redirect.
    {{ DiscussionBoard.errors[10233284].message }}
  • Profile picture of the author yukon
    Banned
    OP dropped off the face of the earth once I showed him his site has been indexed the entire time.

    You're welcome.
    {{ DiscussionBoard.errors[10236051].message }}
    • Profile picture of the author cbpayne
      Originally Posted by yukon View Post

      OP dropped off the face of the earth once I showed him his site has been indexed the entire time.
      You're welcome.
      Yep, it was indexed all the time. What a way for the OP to waste a lots of peoples time.

      Having said that, it should be deindexed as the site is a poorly written piece of junk......HINT: at risk of manual 'pure spam' penalty from Google
      {{ DiscussionBoard.errors[10236228].message }}

Trending Topics