Forcing Google to crawl a web site

by 19 replies
23
Trying to test the best ways to get google to crawl a web site straight away. Would be interested in any suggestions or techniques people have used that worked for them. Not looking at general optimisation techniques but best ways to kick strat google to crawl a new or relaunched site.
Thanks
#search engine optimization #crawl #forcing #google #site #web
  • Submit your sitemap to Google's webmaster tools.... regards Allen
  • ping it
    Have a webmaster tools/analytics account
    Build links on well spidered sites...or forums.
    link to it from a blogger blog
    submit sitemap to google/webmaster tools
  • if you are using wordpress google xml sitemap will do create an account in google webmasters tools and upload your sitemap.xml there.
  • I agree with Allen and Jazbo. Good luck to you Andy.
  • Social media bookmarking and sharing can also help.
    • [1] reply
    • Yes.. I submitted my site to reddit.com and it helped my site's indexing faster.

      Now I am on Google Top 10 for the keyword I targeted. And that's just my first site. It's a great feeling to be on top 10 of google for a keyword with 555,000 searches per month. Thanks to helping warriors like your good self. Thank you warrior forum.
  • [DELETED]
    • [1] reply
  • Places Like Pingfarm etc... can force them to crawl your sites
    • [1] reply
    • definately use pingfarm and submit a sitemap
  • As suggested above - google webmaster tools -> submit sitemap, but...

    What I found to be most effective to get your site indexed is doing simple things:

    1. Post update on Twitter, best if account is established, not brand new - post link to main site
    2. If you already have an established Facebook page - get a link on there.

    It doesn't matter if those links are nofollow - it get SE's to go to your site and index them. Simple and works every time.
  • What others just said, in addition get a link from a frequently crawled site/page ... but not really necessary, usually a ping will do the job.
  • Social bookmarking is one the easiest yet one of the most effective ways to help Google to crawl your website.
    • [ 1 ] Thanks
  • The best way is to create a Sitemap & submit it to Google Webmaster Tools. Also, if you have videos on your site, you can create a Video Sitemap.
  • Submit your site to some credible social bookmarking sites and Google will definitely crawl your site.
  • ping your site a couple times and submit a site map
    • [ 1 ] Thanks
  • Created a trusted site. That way you hit Publish, and it's indexed in 1 second.
  • Please check if your site is enabled for search engine robots to crawl. If it's current status is private, change it to public for the search engines to crawl.

    If there is no problem about privacy settings, and if you want faster crawling, use Google Webmaster Tools. In the settings menu, keep the crawl rate to "recommended" level. After that, submit sitemap.xml. Also use robots.txt. It will make your site more crawlable, for sure.
  • Good idea jazbo.
    I believe if he follows your advice, everything will be okay.
Join the discussion

Next Topics on Trending Feed

  • 23

    Forcing Google to crawl a web site

    Trying to test the best ways to get google to crawl a web site straight away. Would be interested in any suggestions or techniques people have used that worked for them. Not looking at general optimisation techniques but best ways to kick strat google to crawl a new or relaunched site. Thanks