Google Crawling But Not Indexing?

11 replies
  • SEO
  • |
I can usually get new sites indexed pretty quickly...within a few days at most.

But I have a bunch of new blogs created about a month ago, which Google is stubbornly refusing to index. Doing a "site:domain.com" search for any of them brings up zero results.

However, the weird thing is that the Googlebot is crawling all over them, and has been for some time. Some are getting crawled every few minutes. And some are even get search traffic from Google.

Yet the site: command still says, zip, yada, nothing...

What the heck does that mean?

I did wonder if they had been indexed and then quickly de-indexed for some accidental violation of Google's ToS. But as they are all good sites with unique content, I can't see why that should happen. And in any case, surely the Googlebot would not waste resources constantly crawling a de-indexed site?

Any ideas, anyone?
#crawling #google #indexing
  • Profile picture of the author halfbakedrew
    How old is the site? Is the site it self index? How many backlinks are you doing at once. If your doing to many then it could hurt it. Also make sure the back links point to the page you are checking, "site:domain.com" and not "site:domain.com/add"
    check your 301 aswell.
    Signature
    http://www.seodrew.com/

    Alot of poeple say they cant start they're business because of the lack of money so I have started a company that works with you to get started on your online business
    {{ DiscussionBoard.errors[3984237].message }}
  • Profile picture of the author paulgl
    Originally Posted by Rob@TheCopyWriter.com View Post

    I did wonder if they had been indexed and then quickly de-indexed for some accidental violation of Google's ToS. But as they are all good sites with unique content, I can't see why that should happen. And in any case, surely the Googlebot would not waste resources constantly crawling a de-indexed site?
    Any ideas, anyone?
    They don't index then de-index on some sort of accidental violation.

    If they don't crawl de-indexed, or un-indexed sites, how do they get
    new ones in the system? It's constantly changing.

    The google bot crawler is actually there to save resources, not waste them.
    Its saved data is what gives instant search results.

    Be patient. It will probably come back up. Give it at least one solid backlink
    on another page that is constantly crawled.

    Paul
    Signature

    If you were disappointed in your results today, lower your standards tomorrow.

    {{ DiscussionBoard.errors[3985169].message }}
  • Profile picture of the author yukon
    Banned
    OP, post a link so we can see If anything sticks out.

    Believe it or not, I've seen people on this forum run a noindex tag & wonder why Google doesn't like their pages, lol.

    Not saying your running a noindex, just saying things happen...
    {{ DiscussionBoard.errors[3985235].message }}
  • Profile picture of the author masterjani
    First check your .htaccess file if there is anything is disallowed.

    Add your url to google and 140+ search engines.Add analytics code and submit your sitemap to it.Surely it will index unless it is violated any google terms that also you will get in webmasters tools
    {{ DiscussionBoard.errors[3985283].message }}
  • Profile picture of the author jducey1234
    Crawled nut not indexed? That does not sound right to me. As soon as Google finds it, it indexes it.
    {{ DiscussionBoard.errors[3985310].message }}
    • Profile picture of the author HKSEO Rotzee
      Originally Posted by jducey1234 View Post

      Crawled nut not indexed? That does not sound right to me. As soon as Google finds it, it indexes it.
      Thats not true at all. If that was true, we wouldn't have to work half as hard
      {{ DiscussionBoard.errors[3985583].message }}
  • Profile picture of the author bigcat1967
    I usually go to pingomatic and ping the index page.
    Signature

    <a href="https://changeyourbudget.com/save-money-on-your-water-bill/">How to Lower Your Water Bill</a>

    {{ DiscussionBoard.errors[3985510].message }}
  • Profile picture of the author GetMoreTraffic
    Thanks for the replies - I think I have figured it out.

    It looks like it was the Google Blog Search spider that was crawling. Which explains why there was spider activity from Google, and some searches, despite not being in the main index.

    Anyway, Google Webmaster Tools is now starting to show some URLs indexed, and some impressions in searches, but the site: commmand still brings back zilch...maybe that will change over the next few days.
    Signature
    Discover the fast way to accelerate your affiliate income
    {{ DiscussionBoard.errors[3988414].message }}
  • Profile picture of the author seoforu
    One simple suggestion:- Just type the site's url in google and check if its there.Do not worry if its not coming from the site: operator, Google has the site in its index.Sometimes it takes a longer time than anticipates....bow to the masters!
    Signature

    Guest post links are effective when they are contextual and natural!!

    {{ DiscussionBoard.errors[3988444].message }}
  • Profile picture of the author kiddoman
    Maybe you have built too many blogs with the similar domain name! Google may suspend you for this! It may also be caused by some other violation actions!
    Signature

    Small Business for Women's Clothing:
    Fashionable sweet lolita dress with various styles | cheap Gothic lolita dress for female | Affordable Latex Catsuits | Cheap Latex Clothes
    Any Suggestions are Warmly Welcomed - My Lolita Dress

    {{ DiscussionBoard.errors[3988563].message }}
  • Profile picture of the author dhiraj161298
    Consult google help
    Signature

    Download Highly Compressed Games and Latest Softwares from http://appsforwindows.blogspot.com
    http://www.windowsfreeapps.com

    {{ DiscussionBoard.errors[3988937].message }}

Trending Topics