Not getting crawled, am I missing something

14 replies
  • SEO
  • |
Not sure if anyone can help, but I can't get my new site crawled and its annoying. Its my site for a real world business and I am not sure if I missed something. The SEO and anchors are not ideal, but that can be fixed once I get some new artwork and text for the site.

I have a few posts in a few decent dofollow blogs, a squidoo lens, some links in some not so great blogs, a feedburn RSS feed, and some social bookmarks. But it would appear in google webmaster tools its not ever been crawled.

Am I missing something simple?
#crawled #missing
  • 1. Check your weblogs. Google webmaster tools is not always accurate.
    2. If you have other sites, link to this one, it will expediate the process.
    3. If you have wordpress installed, using the pinging service, that helps expediate the crawling process for many.
    4. Be patient Crawling can take anywhere from 24 hours to 1-2 weeks, depending on the amount of promotion you have done.
    Signature
    Pick a product. Pick ANY product! -> 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9
    {{ DiscussionBoard.errors[1823891].message }}
  • Profile picture of the author SuzanneH
    If you're using Wordpress, make sure it's not set to private.

    Settings Privacy SubPanel WordPress Codex

    Suzanne
    {{ DiscussionBoard.errors[1823999].message }}
  • Profile picture of the author pavionjsl
    If it is not indexed here is a tool I use its free. Do the new window setting, start with the 10/50 setting, this submits your site to sites all over the world creating back-links and makes the search engines crawl your site. VerifiedFile.com - SEO Ranking Services - Quick Google Index
    {{ DiscussionBoard.errors[1824013].message }}
  • Profile picture of the author AnthonyATL
    Thanks let me go check those things right now
    {{ DiscussionBoard.errors[1824060].message }}
  • Profile picture of the author Terry Hatfield
    You just created your site march 1 give it a few days it will show up. I find seven days to be a magic number on a lot of sites.
    {{ DiscussionBoard.errors[1824170].message }}
  • Profile picture of the author Loren Woirhaye
    I always get sites crawled within hours. Doesn't mean
    they get indexed though. New sites, even when they
    get crawled, sometimes get sandboxed.

    Google submit won't hurt you. It won't stop sandboxing
    but it will get you spider traffic.

    Submitting to other engines you can do as well. It won't
    hurt you to do it.
    {{ DiscussionBoard.errors[1824274].message }}
    • Profile picture of the author AnthonyATL
      I know its a new site, but odd that I didn't even see crawler hits.
      {{ DiscussionBoard.errors[1824660].message }}
      • Profile picture of the author RanD
        Originally Posted by AnthonyATL View Post

        I know its a new site, but odd that I didn't even see crawler hits.
        The crawlers have millions of sites to crawl, and some of the bigger sites get crawled several times a day. If you put up a new site, it is going to take a while to find your small little site in a sea of millions. You can increase the chances of it getting crawled sooner by creating backlinks to it and submitting it to places mentioned above. This is because the spider finds the link somewhere else and follows it to your site. Without that, the search engines don't even know your site exists. They will eventually will stumble upon it, but it takes time.

        If you just throw up a site without doing anything else, it could take a month or more before getting found by the spiders. I certainly wouldn't fret over 3 days.
        {{ DiscussionBoard.errors[1824733].message }}
        • Profile picture of the author AnthonyATL
          Originally Posted by RanD View Post

          The crawlers have millions of sites to crawl, and some of the bigger sites get crawled several times a day. If you put up a new site, it is going to take a while to find your small little site in a sea of millions. You can increase the chances of it getting crawled sooner by creating backlinks to it and submitting it to places mentioned above. This is because the spider finds the link somewhere else and follows it to your site. Without that, the search engines don't even know your site exists. They will eventually will stumble upon it, but it takes time.

          If you just throw up a site without doing anything else, it could take a month or more before getting found by the spiders. I certainly wouldn't fret over 3 days.
          I understand, I thought I did a bit of that already but my hosting service on this site has such limited SEO tools it kind of bites. Oh well time to try these ideas and maybe some additional backlink.
          Annoying part is this is actually my business site, I am sick of dealing with publishers and decided I wanted to work directly with customers. I have had ad revenue sites show up quicker...
          {{ DiscussionBoard.errors[1824875].message }}
  • Profile picture of the author Marhelper
    Go to Home | Propeller and then go to Blog and Ping Tool - Use Pingler.com to Drive Traffic your Blogs and Websites and insert the Propeller url link in it and you should be up an running in no time.

    You can also go to Digg - The Latest News Headlines, Videos and Images and do the same. Between the two, you will be up and running.
    {{ DiscussionBoard.errors[1824750].message }}
  • Profile picture of the author Andy Marco
    Hi there,

    To try and speed things up a little you could try using OnlyWire. In addition to this I would do a search for your site using Google's Keyword Tool. Google doesn't like not knowing :-) Generally it just takes time and you've done a fair bit to help things along. Onlywire is a really useful tool though.

    Good luck
    {{ DiscussionBoard.errors[1825079].message }}
    • Profile picture of the author AnthonyATL
      Thanks gang you are a big help, I think after I hit up all these other ideas I should get indexed (I hope). Trying to get in there before I start a direct mail advertising campaign, it is kind of a long name/URL and I am thinking just in case + plus you really do need to "hit" potential customers 6 or 7 times
      {{ DiscussionBoard.errors[1825958].message }}
      • Profile picture of the author simpleonline1234
        If it's your anchor link text on your sig then it's indexed and has been crawled..if not toss the url into identi.ca and it will get indexed in a few minutes.


        Google
        Signature
        Check out deals
        {{ DiscussionBoard.errors[1826100].message }}
  • Profile picture of the author AnthonyATL
    Thanks gang, it got crawled and indexed a hr or so after my last post - looks like it was from the verifiedfile tool. Now I need to work on getting the right keywords, but I will take most anything before my direct mail goes out
    {{ DiscussionBoard.errors[1826603].message }}

Trending Topics