How to encourage a google crawl?

16 replies
  • SEO
  • |
Hello guys,

I have recently been trying to promote and carry out some SEO for an offline business. I am not by any stretch an SEO expert but certainly have the basics of how to do the job.

My problem is that google crawled the site on the 7th of August and promptly positioned the site around position 70 in the serps.

Since then, we have carried some improved onsite optimization including proper use of keywords and headers and given all pictures tags etc.

We have carried out some quality backlinking, we have bookmarked and submitted the rss feed etc after updating som eof the content on a few occasions....

Yet here we are on the 25th, some 18 days later and we are still sitting around position 70 and google has not visited the site to crawl since we have carried out this seo work.

Any good methods to help encourage google to visit and re evaluate the site?

I have been tempted to build more and more backinks, but dont want to go mad with it, as i would rather see a steady progress rather than damage the site with an overly aggressive backlinking strategy.

Thanks in advance for any tips!

Paul
#crawl #encourage #google
  • Profile picture of the author Terri Tutten
    Do you have a sitemap, and is it submitted? Have you pinged?
    {{ DiscussionBoard.errors[1117541].message }}
  • Profile picture of the author tommen
    Besides having a sitemap that is submitted to Google, you can do a few blog comments on high traffic blogs (in your niche) and Google will find your site when it crawls the blogs.
    Signature
    {{ DiscussionBoard.errors[1117552].message }}
    • Profile picture of the author Paul Davidson
      Hey guys, yes i have submitted the rss feed as well as pinging the site on a couple of occasions.

      I have my site map plugin activated too!

      But i havent left any blog comments on related forums, i have an article i could put up on ezine, i should be doing that anyway!

      Any other comments would be appreciated

      Cheers

      Paul
      {{ DiscussionBoard.errors[1117591].message }}
  • Profile picture of the author peetred
    Have you tried anything like 3stepads.com or another good one is Organic SEO

    I get my sites crawled pretty quickly with both. The more popular the keywords, the faster.
    Signature

    [CENTER]Founder of Nerdy Millennial - a blog all about millennials sharing their passions, ideas, and expertise. We love to share our knowledge about blogging, healthy living, psychology, arts, culture, and more! Interested in contributing? Contact us to pitch your idea or submit an article.

    {{ DiscussionBoard.errors[1117614].message }}
  • Profile picture of the author Scott Ames
    1. Stand outside and yell "Here Google Google Google"
    2. Buy a Google whistle and blow it
    3. Put Google treats outside your door and wait

    Seriously though. My belief, and I could be wrong since Google changes things often, is that if you keep updating content that Google will keep adjusting their visits until it visits twice and sees no updates. I don't know how long that will take and if it is even correct. I just know that added content daily will help.
    Signature

    Success consists of going from failure to failure without loss of enthusiasm. -Winston Churchill

    {{ DiscussionBoard.errors[1117633].message }}
    • Profile picture of the author Paul Davidson
      Scott....

      You just made my day buddy!

      That is just the best answer i could have hoped for, ..........cos it made me laugh out loud!

      Excellent, the best one was for me to go and buy a Google whistle and blow it....excellent stuff!

      Seriously tho, i will update the site with some new content, then submit and ping once again.

      TBH honest, i have not submitted the rss feeds from the backlinks i have built or pinged them, so that will be done too!

      Thanks for making me laugh and for the input!

      Cheers

      Paul

      Originally Posted by Scott Ames View Post

      1. Stand outside and yell "Here Google Google Google"
      2. Buy a Google whistle and blow it
      3. Put Google treats outside your door and wait

      Seriously though. My belief, and I could be wrong since Google changes things often, is that if you keep updating content that Google will keep adjusting their visits until it visits twice and sees no updates. I don't know how long that will take and if it is even correct. I just know that added content daily will help.
      {{ DiscussionBoard.errors[1117749].message }}
      • Profile picture of the author JakeDaly
        I saw in a thread just last week that apparently even typing "site: yourdomain.com" into Google sometimes alerts the bots to head your way. In addition to pinging, manually submitting your site to Google & submitting a sitemap, there's little else to do but wait.
        {{ DiscussionBoard.errors[1117779].message }}
  • Profile picture of the author ptone
    1) Check to make sure your privacy settings in WP is not set to block robots...several reports with this problem lately.

    2) Have you included your site in your Google Webmaster Tools account? If so, are there any errors reported here? If not, then you may want to consider doing so. Then manually submit your sitemap in Google Webmaster Tools and see if Google finds any errors.
    {{ DiscussionBoard.errors[1117660].message }}
  • Profile picture of the author SteveJohnson
    My problem is that google crawled the site on the 7th of August and promptly positioned the site around position 70 in the serps.
    Main point #1 - The great and powerful G does not position 'the site'. It ranks a page for importance and relevance to the search term. When you see the main domain name, Mr. G is ranking the importance of the home page of the site, not the site itself.

    What search term(s) does each page of the site target? How does each particular page rank for its main keyword phrase/search term?
    Signature

    The 2nd Amendment, 1789 - The Original Homeland Security.

    Gun control means never having to say, "I missed you."

    {{ DiscussionBoard.errors[1117802].message }}
    • Profile picture of the author Paul Davidson
      Yes Steve, it has ranked the page, unfortunately the big G was very quick to visit the site first time around and basically the site was not finished, and it was certainly not optimised for very much at that point.

      At the point that google made its crawl, the page it crawled was totally non keyword optimised..... it is only since then that thet site has been organised and sorted!

      Google was too quick off the mark, they beat me to it, they crawled before i was ready, yes it was sloppy on my behalf, and its a mistake i wont make again in a hurry!

      Thanks to all for the advise, i will be trying a few things over the next 24 hours!

      Keep them coming, thanks again...

      Paul

      Originally Posted by SteveJohnson View Post

      Main point #1 - The great and powerful G does not position 'the site'. It ranks a page for importance and relevance to the search term. When you see the main domain name, Mr. G is ranking the importance of the home page of the site, not the site itself.

      What search term(s) does each page of the site target? How does each particular page rank for its main keyword phrase/search term?
      {{ DiscussionBoard.errors[1117846].message }}
      • Profile picture of the author dburk
        Originally Posted by Paul Davidson View Post

        Yes Steve, it has ranked the page, unfortunately the big G was very quick to visit the site first time around and basically the site was not finished, and it was certainly not optimised for very much at that point.

        At the point that google made its crawl, the page it crawled was totally non keyword optimised..... it is only since then that thet site has been organised and sorted!

        Google was too quick off the mark, they beat me to it, they crawled before i was ready, yes it was sloppy on my behalf, and its a mistake i wont make again in a hurry!

        Thanks to all for the advise, i will be trying a few things over the next 24 hours!

        Keep them coming, thanks again...

        Paul
        Hi Paul,

        Ah Ha... the real problem comes out!

        Seems Google crawled too quickly while we were trying to figure out why they haven't crawled yet.

        You need to have some patience, they will come back but on their own schedule. There isn't much you can do between crawls to influence the crawl rate. Add more pages of content and continue creating backlinks, your problem will sort itself out soon enough.
        {{ DiscussionBoard.errors[1118851].message }}
  • Profile picture of the author locpic63
    Link your blog to your signature here, make a post and google will be there within the hour!
    (see thread in plug in profit forum how to get google to crawl my site)

    Locpic 63
    {{ DiscussionBoard.errors[1118876].message }}
    • Profile picture of the author Paul Davidson
      Hey Don,

      Yes the truth comes out in the end!.......lol

      Locpic

      I have also been over to the Thread mentioned and yes, ther are some good tips there too.

      I have been a left a few linked messages on Twitter and a related Forum, so fingers crossed that we will make a good jump in the serps....

      I will keep this thread posted as to my progress

      Cheers and many thanks to all

      Paul
      {{ DiscussionBoard.errors[1119779].message }}
      • Profile picture of the author Joshua.E1
        A blog will help a lot in ranking and getting the website to be crawl frequently (if you blog frequently).

        Another way is to add in new web page with new content to the website, then get that web page ping, using Pingler.

        These two methods of adding new content day by day for a month, will condition the web spiders to claw your website frequently.

        Hope it helps.
        {{ DiscussionBoard.errors[1120026].message }}
        • Profile picture of the author saggy23
          I think you've already taken all the measures which are required from SEO perspective. It's really hard to say when and how often Google will crawl your website. In addition with all the work you're doing try to add some unique content in do follow article sites and link back your site from some relevant keywords to your site.
          {{ DiscussionBoard.errors[1120146].message }}
  • Paul

    I am surprised you have not put your site in your siggy.You have over 100 posts.This would have definitely helped your site in the search engines
    {{ DiscussionBoard.errors[1120166].message }}

Trending Topics