Forcing Google to crawl a web site

19 replies
  • SEO
  • |
Trying to test the best ways to get google to crawl a web site straight away. Would be interested in any suggestions or techniques people have used that worked for them. Not looking at general optimisation techniques but best ways to kick strat google to crawl a new or relaunched site.
Thanks
#crawl #forcing #google #site #web
  • Profile picture of the author allenjohn
    Submit your sitemap to Google's webmaster tools.... regards Allen
    Signature

    Make Money with Niche Blogs Auto Profit - Let us build YOUR auto blogging empire for you. BUY BACK GUARANTEE for Gold Orders! FAQ - NEW! - One Way Link Building Service

    {{ DiscussionBoard.errors[3912425].message }}
  • Profile picture of the author jazbo
    ping it
    Have a webmaster tools/analytics account
    Build links on well spidered sites...or forums.
    link to it from a blogger blog
    submit sitemap to google/webmaster tools
    Signature
    CONTENT WRITER. Reliable, UK-Based, 6 Years Experience - ANY NICHE
    Click Here For Writing Samples & Online Ordering
    {{ DiscussionBoard.errors[3912465].message }}
  • Profile picture of the author firebane05
    if you are using wordpress google xml sitemap will do create an account in google webmasters tools and upload your sitemap.xml there.
    Signature
    TheFitPanda - Health & Wellness that Inspires
    {{ DiscussionBoard.errors[3912483].message }}
  • Profile picture of the author Claire Sharp
    I agree with Allen and Jazbo. Good luck to you Andy.
    {{ DiscussionBoard.errors[3912925].message }}
  • Profile picture of the author webmedia
    Social media bookmarking and sharing can also help.
    {{ DiscussionBoard.errors[3912934].message }}
    • Profile picture of the author jskarthik1
      Originally Posted by webmedia View Post

      Social media bookmarking and sharing can also help.
      Yes.. I submitted my site to reddit.com and it helped my site's indexing faster.

      Now I am on Google Top 10 for the keyword I targeted. And that's just my first site. It's a great feeling to be on top 10 of google for a keyword with 555,000 searches per month. Thanks to helping warriors like your good self. Thank you warrior forum.
      {{ DiscussionBoard.errors[3915129].message }}
  • Profile picture of the author Clint Faber
    [DELETED]
    {{ DiscussionBoard.errors[3912947].message }}
    • Profile picture of the author jskarthik1
      Originally Posted by Clint Faber View Post

      we need to do is walk into Google's headquarters and demand that they give you a spider that you can put into your CD drive and have a crawl around in till it appears on your screen and walks across your site in your browser
      That's funny.
      {{ DiscussionBoard.errors[3915140].message }}
      • Profile picture of the author SEO Alien
        From Google Webmaster tools you can submit the URL of a specific page post and/or the homepage.
        Goto https://www.google.com/webmasters/tools (sign in) and then HEALTH -> FETCH AS GOOGLE. It will typically be crawled with 24 hours or less
        {{ DiscussionBoard.errors[7743640].message }}
  • {{ DiscussionBoard.errors[3912962].message }}
  • Profile picture of the author Alex_Sysoef
    As suggested above - google webmaster tools -> submit sitemap, but...

    What I found to be most effective to get your site indexed is doing simple things:

    1. Post update on Twitter, best if account is established, not brand new - post link to main site
    2. If you already have an established Facebook page - get a link on there.

    It doesn't matter if those links are nofollow - it get SE's to go to your site and index them. Simple and works every time.
    {{ DiscussionBoard.errors[3913003].message }}
  • Profile picture of the author Trapped
    What others just said, in addition get a link from a frequently crawled site/page ... but not really necessary, usually a ping will do the job.
    {{ DiscussionBoard.errors[3913016].message }}
  • Profile picture of the author jonnyhardbaked
    Social bookmarking is one the easiest yet one of the most effective ways to help Google to crawl your website.
    Signature

    Acquire an unlimited access to over 2,000 eBooks with unlimited Downloads and resale rights for only $55! Join me now!

    {{ DiscussionBoard.errors[3914780].message }}
  • Originally Posted by andycrids View Post

    Trying to test the best ways to get google to crawl a web site straight away. Would be interested in any suggestions or techniques people have used that worked for them. Not looking at general optimisation techniques but best ways to kick strat google to crawl a new or relaunched site.
    Thanks
    The best way is to create a Sitemap & submit it to Google Webmaster Tools. Also, if you have videos on your site, you can create a Video Sitemap.
    {{ DiscussionBoard.errors[3914926].message }}
  • Profile picture of the author HavenX
    Submit your site to some credible social bookmarking sites and Google will definitely crawl your site.
    {{ DiscussionBoard.errors[3914927].message }}
  • Profile picture of the author hub92
    ping your site a couple times and submit a site map
    {{ DiscussionBoard.errors[3915014].message }}
  • Profile picture of the author Fernando Veloso
    Created a trusted site. That way you hit Publish, and it's indexed in 1 second.
    Signature
    People make good money selling to the rich. But the rich got rich selling to the masses.
    {{ DiscussionBoard.errors[3915070].message }}
  • Profile picture of the author jskarthik1
    Please check if your site is enabled for search engine robots to crawl. If it's current status is private, change it to public for the search engines to crawl.

    If there is no problem about privacy settings, and if you want faster crawling, use Google Webmaster Tools. In the settings menu, keep the crawl rate to "recommended" level. After that, submit sitemap.xml. Also use robots.txt. It will make your site more crawlable, for sure.
    {{ DiscussionBoard.errors[3915105].message }}
  • Profile picture of the author gax444
    Good idea jazbo.
    I believe if he follows your advice, everything will be okay.
    {{ DiscussionBoard.errors[7743700].message }}

Trending Topics