Go Back   WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum
Register Blogs FAQ Social Groups CalendarHelp Desk

Reply
 
LinkBack Thread Tools
Old 05-19-2011, 02:58 AM   #1
Andy Crids
 
Join Date: May 2011
Posts: 1
Thanks: 0
Thanked 0 Times in 0 Posts
Default Forcing Google to crawl a web site

Trying to test the best ways to get google to crawl a web site straight away. Would be interested in any suggestions or techniques people have used that worked for them. Not looking at general optimisation techniques but best ways to kick strat google to crawl a new or relaunched site.
Thanks

andycrids is offline   Reply With Quote
Old 05-19-2011, 03:39 AM   #2
Senior Warrior Member
War Room Member
 
allenjohn's Avatar
 
Join Date: Nov 2008
Posts: 1,472
Thanks: 120
Thanked 121 Times in 105 Posts
Social Networking View Member's Myspace Profile  View Member's FaceBook Profile  View Member's Twitter Profile  View Member's YouTube Profile
Default Re: Forcing Google to crawl a web site

Submit your sitemap to Google's webmaster tools.... regards Allen

Make Money with Niche Blogs Auto Profit - Let us build YOUR auto blogging empire for you. BUY BACK GUARANTEE for Gold Orders! FAQ - NEW! - One Way Link Building Service
allenjohn is offline   Reply With Quote
Old 05-19-2011, 03:47 AM   #3
Systematic Warrior
War Room Member
 
jazbo's Avatar
 
Join Date: Oct 2009
Location: Norfolk, England.
Posts: 1,911
Blog Entries: 9
Thanks: 35
Thanked 296 Times in 218 Posts
Social Networking View Member's Twitter Profile 
Default Re: Forcing Google to crawl a web site

ping it
Have a webmaster tools/analytics account
Build links on well spidered sites...or forums.
link to it from a blogger blog
submit sitemap to google/webmaster tools

jazbo is offline   Reply With Quote
Old 05-19-2011, 03:53 AM   #4
Enigma05
 
Join Date: May 2011
Posts: 13
Thanks: 0
Thanked 0 Times in 0 Posts
Contact Info
Send a message via Yahoo to firebane05
Default Re: Forcing Google to crawl a web site

if you are using wordpress google xml sitemap will do create an account in google webmasters tools and upload your sitemap.xml there.

firebane05 is offline   Reply With Quote
Old 05-19-2011, 05:47 AM   #5
HyperActive Warrior
 
Join Date: Apr 2011
Posts: 453
Thanks: 1
Thanked 20 Times in 20 Posts
Default Re: Forcing Google to crawl a web site

I agree with Allen and Jazbo. Good luck to you Andy.
Claire Sharp is offline   Reply With Quote
Old 05-19-2011, 05:49 AM   #6
Active Warrior
 
Join Date: Aug 2010
Location: us
Posts: 55
Thanks: 0
Thanked 2 Times in 2 Posts
Default Re: Forcing Google to crawl a web site

Social media bookmarking and sharing can also help.
webmedia is offline   Reply With Quote
Old 05-19-2011, 05:57 AM   #7
ephame.com
War Room Member
 
ephame's Avatar
 
Join Date: Apr 2011
Location: Australia
Posts: 228
Thanks: 21
Thanked 20 Times in 19 Posts
Social Networking View Member's FaceBook Profile  View Member's Twitter Profile 
Default Re: Forcing Google to crawl a web site

Places Like Pingfarm etc... can force them to crawl your sites
ephame is offline   Reply With Quote
Old 05-19-2011, 05:58 AM   #8
Warrior Member
 
Join Date: Jan 2011
Posts: 13
Thanks: 0
Thanked 0 Times in 0 Posts
Default Re: Forcing Google to crawl a web site

definately use pingfarm and submit a sitemap

MoneyMouse is offline   Reply With Quote
Old 05-19-2011, 06:06 AM   #9
Advanced Warrior
War Room Member
 
Alex_Sysoef's Avatar
 
Join Date: May 2006
Location: Virginia Beach, USA.
Posts: 551
Blog Entries: 1
Thanks: 6
Thanked 17 Times in 14 Posts
Social Networking View Member's FaceBook Profile  View Member's Twitter Profile  View Member's YouTube Profile
Default Re: Forcing Google to crawl a web site

As suggested above - google webmaster tools -> submit sitemap, but...

What I found to be most effective to get your site indexed is doing simple things:

1. Post update on Twitter, best if account is established, not brand new - post link to main site
2. If you already have an established Facebook page - get a link on there.

It doesn't matter if those links are nofollow - it get SE's to go to your site and index them. Simple and works every time.

WordPress Under 4 Min? - Fully installed, configured and with custom theme $17 - UNLIMITED Installs!
Be My Twitter Friend - Latest WP info in 140 characters or less!
The WordPress Spotter - blog that teaches you all you need to know about WordPress
Alex_Sysoef is offline   Reply With Quote
Old 05-19-2011, 06:09 AM   #10
HyperActive Warrior
 
Join Date: Jan 2009
Posts: 247
Thanks: 60
Thanked 28 Times in 26 Posts
Social Networking View Member's Twitter Profile 
Contact Info
Send a message via MSN to Trapped Send a message via Skype™ to Trapped
Default Re: Forcing Google to crawl a web site

What others just said, in addition get a link from a frequently crawled site/page ... but not really necessary, usually a ping will do the job.

Trapped is offline   Reply With Quote
Old 05-19-2011, 11:25 AM   #11
Advanced Warrior
 
jonnyhardbaked's Avatar
 
Join Date: Feb 2011
Location: Pearl of the East - Pilipinas
Posts: 722
Thanks: 32
Thanked 49 Times in 41 Posts
Default Re: Forcing Google to crawl a web site

Social bookmarking is one the easiest yet one of the most effective ways to help Google to crawl your website.

jonnyhardbaked is offline   Reply With Quote
Old 05-19-2011, 11:48 AM   #12
Julia
 
strategic seo services's Avatar
 
Join Date: Jun 2010
Location: New York
Posts: 1,243
Thanks: 375
Thanked 90 Times in 76 Posts
Default Re: Forcing Google to crawl a web site

Quote:
Originally Posted by andycrids View Post
Trying to test the best ways to get google to crawl a web site straight away. Would be interested in any suggestions or techniques people have used that worked for them. Not looking at general optimisation techniques but best ways to kick strat google to crawl a new or relaunched site.
Thanks
The best way is to create a Sitemap & submit it to Google Webmaster Tools. Also, if you have videos on your site, you can create a Video Sitemap.

strategic seo services is offline   Reply With Quote
Old 05-19-2011, 11:48 AM   #13
Warrior Member
 
HavenX's Avatar
 
Join Date: Apr 2010
Posts: 28
Thanks: 0
Thanked 1 Time in 1 Post
Social Networking View Member's Twitter Profile 
Default Re: Forcing Google to crawl a web site

Submit your site to some credible social bookmarking sites and Google will definitely crawl your site.

HavenX is offline   Reply With Quote
Old 05-19-2011, 12:02 PM   #14
Warrior Member
 
Join Date: May 2011
Posts: 12
Thanks: 0
Thanked 2 Times in 2 Posts
Default Re: Forcing Google to crawl a web site

ping your site a couple times and submit a site map

hub92 is offline   Reply With Quote
Old 05-19-2011, 12:11 PM   #15
Portuguese Warrior
War Room Member
 
Fernando Veloso's Avatar
 
Join Date: Nov 2008
Location: Good Old Europe
Posts: 4,013
Blog Entries: 7
Thanks: 1,660
Thanked 1,053 Times in 705 Posts
Social Networking View Member's FaceBook Profile  View Member's Twitter Profile  View Member's YouTube Profile
Contact Info
Send a message via Skype™ to Fernando Veloso
Default Re: Forcing Google to crawl a web site

Created a trusted site. That way you hit Publish, and it's indexed in 1 second.



Fernando's Internet Marketing Consulting service, "SEO Google Trust",
is fully booked right now - Please check back in July/August. Thank you!
Fernando Veloso is offline   Reply With Quote
Old 05-19-2011, 12:16 PM   #16
HyperActive Warrior
War Room Member
 
jskarthik1's Avatar
 
Join Date: Jul 2010
Location: India
Posts: 101
Thanks: 88
Thanked 13 Times in 10 Posts
Default Re: Forcing Google to crawl a web site

Please check if your site is enabled for search engine robots to crawl. If it's current status is private, change it to public for the search engines to crawl.

If there is no problem about privacy settings, and if you want faster crawling, use Google Webmaster Tools. In the settings menu, keep the crawl rate to "recommended" level. After that, submit sitemap.xml. Also use robots.txt. It will make your site more crawlable, for sure.
jskarthik1 is offline   Reply With Quote
Old 05-19-2011, 12:20 PM   #17
HyperActive Warrior
War Room Member
 
jskarthik1's Avatar
 
Join Date: Jul 2010
Location: India
Posts: 101
Thanks: 88
Thanked 13 Times in 10 Posts
Arrow Re: Forcing Google to crawl a web site

Quote:
Originally Posted by webmedia View Post
Social media bookmarking and sharing can also help.
Yes.. I submitted my site to reddit.com and it helped my site's indexing faster.

Now I am on Google Top 10 for the keyword I targeted. And that's just my first site. It's a great feeling to be on top 10 of google for a keyword with 555,000 searches per month. Thanks to helping warriors like your good self. Thank you warrior forum.
jskarthik1 is offline   Reply With Quote
Old 05-19-2011, 12:24 PM   #18
HyperActive Warrior
War Room Member
 
jskarthik1's Avatar
 
Join Date: Jul 2010
Location: India
Posts: 101
Thanks: 88
Thanked 13 Times in 10 Posts
Default Re: Forcing Google to crawl a web site

Quote:
Originally Posted by Clint Faber View Post
we need to do is walk into Google's headquarters and demand that they give you a spider that you can put into your CD drive and have a crawl around in till it appears on your screen and walks across your site in your browser
That's funny.
jskarthik1 is offline   Reply With Quote
Reply

  WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum

Tags
crawl, forcing, google, site, web

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off



All times are GMT -6. The time now is 08:51 AM.