37 {{ upvoteCount | shortNum }}
37 {{ upvoteCount | shortNum }}

Still not indexed in over 2 weeks!?

by Zinc Web Design
33 replies
  • SEO
    • |
Have never ever experienced this kind of waiting for a site to get indexed before, have around 15 sites all waiting to be indexed?

I have built several links all from different sites but still nothing?

Anyone else experiencing this, I am worried my sites have been penalized.
#indexed #weeks
  • Profile picture of the author Zinc Web Design
    Just me then?
    {{ DiscussionBoard.errors[1458216].message }}
    • Profile picture of the author nota-bene
      Have you submitted them to Google webmaster tools?
      Signature

      {{ DiscussionBoard.errors[1458220].message }}
      • Profile picture of the author Zinc Web Design
        yes, when they went live
        {{ DiscussionBoard.errors[1458224].message }}
        • Profile picture of the author nota-bene
          Never had this problem...

          You got an example site you can PM, I will happily investigate for you!
          Signature

          {{ DiscussionBoard.errors[1458233].message }}
  • Profile picture of the author policy
    Does your google webmaster account show any errors?
    {{ DiscussionBoard.errors[1458249].message }}
  • Profile picture of the author hally0301
    Can't say that I have had this drama before.

    I usually just submit sitemap to Google Webmaster tools. I also use Google Analytics on all my sites.

    Just got a new site indexed the other day in about 48 hours. Didn't even do any great link building for that.

    PM the site and I will have a look and see
    Signature

    Steve Hall

    Business Website Design Services

    {{ DiscussionBoard.errors[1458257].message }}
    • Profile picture of the author Zinc Web Design
      There is an error in the webmaster tools of the affected sites -

      robots.txt unreachable, which I don't quite understand?

      an example site would be - detailsander (dot) net

      -thanks guys
      {{ DiscussionBoard.errors[1458277].message }}
  • Profile picture of the author mediaguy
    Are you using WordPress?
    Signature
    Just Make It Happen - Stop Making Excuses! Only failure is not taking action!
    {{ DiscussionBoard.errors[1458284].message }}
    • Profile picture of the author Zinc Web Design
      no they are static html, just launched a wordpress site though to try that - I had read that it comes pre set to block search engines but the options when I set it up yesterday were set to visible to se's?
      {{ DiscussionBoard.errors[1458292].message }}
      • Profile picture of the author edgray
        hally0301 is right:

        To get a new site indexed within 48 hours you need to

        1) install Google's Webmaster Tools
        2) Submit an xml sitemap to Google
        3) make a few comments on high ranking blogs and forums.

        I've never failed to get a new site on very quickly using this method.
        Signature

        Ed Gray
        A Business Opportunity in Travel with Personal Travel Group
        Macintosh Training, Repair and Support
        Modern Zen Watch

        {{ DiscussionBoard.errors[1458313].message }}
      • Profile picture of the author Zinc Web Design
        some of the sites are showing crawl activity in webmaster tools, but this robots.txt unreachable is worrying - cant find any solid info about it
        {{ DiscussionBoard.errors[1458316].message }}
  • Profile picture of the author nota-bene
    Your robots.txt reads:

    User-agent: *
    Disallow: /terms.html
    Disallow: /privacy.html
    Disallow: /access.html
    Disallow: /about.html
    Disallow: /contact.html
    Disallow: /sitemap.html


    So basically you are not allowing google to crawl anything at all!!

    *EDIT - This might help you out a bit - http://www.outfront.net/tutorials_02...ech/robots.htm

    See #3 for what you need you robots.txt to look like
    Signature

    {{ DiscussionBoard.errors[1458326].message }}
    • Profile picture of the author Zinc Web Design
      Originally Posted by nota-bene View Post

      Your robots.txt reads:

      User-agent: *
      Disallow: /terms.html
      Disallow: /privacy.html
      Disallow: /access.html
      Disallow: /about.html
      Disallow: /contact.html
      Disallow: /sitemap.html


      So basically you are not allowing google to crawl anything at all!!

      *EDIT - This might help you out a bit - Creating and Using a robots.txt File

      See #3 for what you need you robots.txt to look like
      That robots.txt allows robots to crawl the homepage (.index.html) ??
      {{ DiscussionBoard.errors[1458356].message }}
    • Profile picture of the author edgray
      Originally Posted by nota-bene View Post

      Your robots.txt reads:

      User-agent: *
      Disallow: /terms.html
      Disallow: /privacy.html
      Disallow: /access.html
      Disallow: /about.html
      Disallow: /contact.html
      Disallow: /sitemap.html


      So basically you are not allowing google to crawl anything at all!!

      *EDIT - This might help you out a bit - Creating and Using a robots.txt File

      See #3 for what you need you robots.txt to look like
      Google still trawls disallowed pages. The only way to stop google putting a page in the SERPs is to use the "noindex" attribute.
      Signature

      Ed Gray
      A Business Opportunity in Travel with Personal Travel Group
      Macintosh Training, Repair and Support
      Modern Zen Watch

      {{ DiscussionBoard.errors[1458377].message }}
      • Profile picture of the author nota-bene
        Originally Posted by edgray View Post

        Google still trawls disallowed pages. The only way to stop google putting a page in the SERPs is to use the "noindex" attribute.

        It does indeed still crawl disallowed pages, but it does not necessarily mean that they WILL be indexed.

        "You need a robots.txt file only if your site includes content that you don't want search engines to index. If you want search engines to index everything in your site, you don't need a robots.txt file (not even an empty one)."
        Signature

        {{ DiscussionBoard.errors[1458395].message }}
        • Profile picture of the author Zinc Web Design
          Yes I know this but I have many sites with the same t&c's etc so dont want them in there.

          If I changed hosts how would this effect my sites, if I pointed the dn's to anew host and set up there as I am sure it is due to the hosts firewall blocking the ip google is using to access my site.
          {{ DiscussionBoard.errors[1458399].message }}
          • Profile picture of the author nota-bene
            Originally Posted by Zinc Web Design View Post

            Yes I know this but I have many sites with the same t&c's etc so dont want them in there.

            If I changed hosts how would this effect my sites, if I pointed the dn's to anew host and set up there as I am sure it is due to the hosts firewall blocking the ip google is using to access my site.
            Given that they are not being indexed as is...it won't hurt to try! I have just done some further reading and the hosting thing might well be your issue! Never had a problem like this myself though. Let me know how you get on.
            Signature

            {{ DiscussionBoard.errors[1458427].message }}
            • Profile picture of the author Zinc Web Design
              but if sites were indexed would moving hosts affect them
              {{ DiscussionBoard.errors[1458431].message }}
              • Profile picture of the author nota-bene
                Originally Posted by Zinc Web Design View Post

                but if sites were indexed would moving hosts affect them
                As a website flipper I am constantly moving sites from server to server. I have, in only a few cases, noticed a slight move in rankings. As your rankings are non existent as we speak, you will have no issues. Especially given that the site is only a few pages worth.
                Signature

                {{ DiscussionBoard.errors[1458441].message }}
                • Profile picture of the author Zinc Web Design
                  Originally Posted by nota-bene View Post

                  As a website flipper I am constantly moving sites from server to server. I have, in only a few cases, noticed a slight move in rankings. As your rankings are non existent as we speak, you will have no issues. Especially given that the site is only a few pages worth.
                  thanks for you help so far really, really appreciate your help!

                  I was really moving with my sites but this issue had really slowed me down/disheartened my efforts.

                  I am currently with bluehost and would like to try a new host any recommendations, preferably a US host?
                  {{ DiscussionBoard.errors[1458452].message }}
                  • Profile picture of the author nota-bene
                    Originally Posted by Zinc Web Design View Post

                    thanks for you help so far really, really appreciate your help!

                    I was really moving with my sites but this issue had really slowed me down/disheartened my efforts.

                    I am currently with bluehost and would like to try a new host any recommendations, preferably a US host?

                    No problem, mate. We will get it sorted!

                    I tried a number of hosting accounts, bluehost included, before settling on a reseller package with hostgator. Everything has been plain sailing since then!

                    Keep your chin up
                    Signature

                    {{ DiscussionBoard.errors[1458460].message }}
        • Profile picture of the author edgray
          Originally Posted by nota-bene View Post

          It does indeed still crawl disallowed pages, but it does not necessarily mean that they WILL be indexed.

          "You need a robots.txt file only if your site includes content that you don't want search engines to index. If you want search engines to index everything in your site, you don't need a robots.txt file (not even an empty one)."
          I saw a video with Matt Cutts as he explained that google will index everything it comes across. He gave a good example:

          The DMV in California didn't want to be in Google's index. They used robots.txt to tell GoogleBot not to index. Google not only trawled the site but the DMV appeared in the SERPs. Matt Cutts explained that Google will index anything that it thinks is relevant to people, and in this case, the DMV is pretty useful. The only way of keeping something out of the SERPs for sure is with a "noindex" attribute.
          Signature

          Ed Gray
          A Business Opportunity in Travel with Personal Travel Group
          Macintosh Training, Repair and Support
          Modern Zen Watch

          {{ DiscussionBoard.errors[1458434].message }}
          • Profile picture of the author Zinc Web Design
            will having many sites with the same privacy, contact us and about pages be detrimental to my portfolio of sites?
            {{ DiscussionBoard.errors[1458439].message }}
          • Profile picture of the author nota-bene
            Originally Posted by edgray View Post

            I saw a video with Matt Cutts as he explained that google will index everything it comes across. He gave a good example:

            The DMV in California didn't want to be in Google's index. They used robots.txt to tell GoogleBot not to index. Google not only trawled the site but the DMV appeared in the SERPs. Matt Cutts explained that Google will index anything that it thinks is relevant to people, and in this case, the DMV is pretty useful. The only way of keeping something out of the SERPs for sure is with a "noindex" attribute.
            Thanks, Ed.

            I think I have seen the same video actually! Do you have a link to it just out of interest? Slight difference between the DMV and a small adsense site maybe? Either way, it does look like this is more of an issue with the hosting account.

            It is early here too, but this has provided me with something to do while knocking back the first couple of coffees of the day!

            Not so sunny in Spain today?
            Signature

            {{ DiscussionBoard.errors[1458468].message }}
            • Profile picture of the author edgray
              Originally Posted by nota-bene View Post

              Thanks, Ed.

              I think I have seen the same video actually! Do you have a link to it just out of interest? Slight difference between the DMV and a small adsense site maybe? Either way, it does look like this is more of an issue with the hosting account.

              It is early here too, but this has provided me with something to do while knocking back the first couple of coffees of the day!

              Not so sunny in Spain today?
              I wish I could remember where I saw it, I'll try and find it and post the link for you. Yes, I see your point - chances are if you "disallow" a small adsense site then I'm pretty sure Google won't index it!

              Two coffees down for me so far! Its actually nice and sunny here today but COLD!
              Signature

              Ed Gray
              A Business Opportunity in Travel with Personal Travel Group
              Macintosh Training, Repair and Support
              Modern Zen Watch

              {{ DiscussionBoard.errors[1458475].message }}
            • Profile picture of the author Zinc Web Design
              do you think the fact I put around 30 sites up in around two weeks that the constant visiting of the google bot flared up a warning with the servers firewall?

              I am worried that as soon as I move hosts I will get a similar problem :S
              {{ DiscussionBoard.errors[1458477].message }}
              • Profile picture of the author nota-bene
                Originally Posted by Zinc Web Design View Post

                do you think the fact I put around 30 sites up in around two weeks that the constant visiting of the google bot flared up a warning with the servers firewall?

                I am worried that as soon as I move hosts I will get a similar problem :S
                Might want to check that with bluehost, but I should not have thought so. Again, I have put up a larger number of sites and a whole lot more pages in a shorter space. So based on my personal experience, no.

                30 mins...then I realyl should think about doing some work :rolleyes:
                Signature

                {{ DiscussionBoard.errors[1458505].message }}
  • Profile picture of the author madness222
    Originally Posted by Zinc Web Design View Post

    Have never ever experienced this kind of waiting for a site to get indexed before, have around 15 sites all waiting to be indexed?

    I have built several links all from different sites but still nothing?

    Anyone else experiencing this, I am worried my sites have been penalized.
    Maybe your making some mistake in link building try to double check all your work...
    {{ DiscussionBoard.errors[1458329].message }}
  • Profile picture of the author policy
    Zinc,

    I think your best bet is to install a sitemap plugin. Go to your wordpress settings, go to the plugin section, and search "sitemap", the first one in the list will be fine. Install that, and then edit the settings (you can leave default), and then click generate sitemap or whatever it says, and then just copy that url into your google webmaster tools.
    {{ DiscussionBoard.errors[1458357].message }}
    • Profile picture of the author Zinc Web Design
      its a static html
      {{ DiscussionBoard.errors[1458363].message }}
      • Profile picture of the author Zinc Web Design
        I am sure this is a problem with my host, the more I read about this robots.txt unreachable error.

        robots is there but webmaster tools is showing the error and is therefore not crawling as it is not giving a simple 404 to indicate I do not have one
        {{ DiscussionBoard.errors[1458370].message }}
  • Profile picture of the author wf68689933
    Banned
    [DELETED]
    {{ DiscussionBoard.errors[1458389].message }}
    • Profile picture of the author AndyBlackSEO
      Originally Posted by wf68689933 View Post

      maybe you should get more trafic to your website.

      That's what he's trying to do by getting his site indexed in Google?!

      Is the site indexed in Yahoo or Bing?
      Signature
      [FREE SEO TOOL] Build 29 Effective, High Authority Backlinks that Will Increase Your Google Rankings in 2020... CLICK HERE ...
      ... Instant backlinks that can get you results within 24-72hrs.
      {{ DiscussionBoard.errors[1458410].message }}
      • Profile picture of the author Zinc Web Design
        ye just checked and some of my sites are indexed in yahoo!

        i am almost sure it is my host blocking googles ip they are trying to crawl with.

        How would changing my hosts affect my sites?
        {{ DiscussionBoard.errors[1458421].message }}

Trending Topics