Go Back   WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum
Register Blogs FAQ Social Groups CalendarHelp Desk

Reply
 
LinkBack Thread Tools
Old 10-08-2011, 10:30 AM   #1
Peaceful Warrior
War Room Member
 
Ferenc Makar's Avatar
 
Join Date: May 2011
Location: Europe
Posts: 178
Thanks: 67
Thanked 48 Times in 32 Posts
Social Networking View Member's FaceBook Profile  View Member's Twitter Profile 
Default How much time Google bot takes to crawl a site?

Hi everyone,
I want to know that How much time Google boot takes to crawl a site??
Kindly let me know if anyone have any information about that.
Thanks in advance.
Ferenc Makar is online now   Reply With Quote
Old 10-08-2011, 10:32 AM   #2
HyperActive Warrior
War Room Member
 
d0rhk's Avatar
 
Join Date: Dec 2008
Location: Toronto, Canada
Posts: 289
Thanks: 55
Thanked 61 Times in 35 Posts
Default Re: How much time Google bot takes to crawl a site?

It probably takes the google bot milliseconds to crawl a site. The servers they deploy to do this are extremely high powered and on very fast dedicated connections. They probably crawl millions and millions of pages of content every day.
d0rhk is online now   Reply With Quote
Old 10-08-2011, 10:35 AM   #3
HyperActive Warrior
War Room Member
 
Join Date: Feb 2005
Location: , , United Kingdom.
Posts: 238
Thanks: 5
Thanked 89 Times in 22 Posts
Contact Info
Send a message via Skype™ to trevord92
Default Re: How much time Google bot takes to crawl a site?

Unless your site is small it's unlikely they'll crawl it all in one session.

They are pretty "friendly" when they crawl your site and do their best not to slow it down for other users.

Their webmaster info is here: Changing Google's crawl rate - Webmaster Tools Help

trevord92 is offline   Reply With Quote
Old 10-08-2011, 10:56 AM   #4
ÜberActive Warrior
 
Buyseech's Avatar
 
Join Date: Oct 2010
Location: Slovenia
Posts: 277
Thanks: 34
Thanked 24 Times in 22 Posts
Social Networking View Member's FaceBook Profile  View Member's Twitter Profile  View Member's YouTube Profile
Contact Info
Send a message via Skype™ to Buyseech
Default Re: How much time Google bot takes to crawl a site?

Quote:
Originally Posted by FerencMakar View Post
Hi everyone,
I want to know that How much time Google boot takes to crawl a site??
Kindly let me know if anyone have any information about that.
Thanks in advance.
It is not clear from your question wether or not you are looking for the time (in miliseconds) it takes for it to crawl the site or how much time must pass before it gets to your site (i presume its a brand new site and not an authority site).

Big "authority" sites get crawled daily or even more times per day, but smaller sites can take up to a month (if not more) if there is no "action", backlinking etc.

I have wrote an entire post on this subject here -> How to get your website in google in under 30 minutes

Hope it helps.

Sincerely, Buyseech

www.BUYSEECH.com - SEO Tips, Business ideas, Marketing, Outsourcing...(P.s.: My personal BLOG)
Buyseech is online now   Reply With Quote
Old 10-08-2011, 12:34 PM   #5
Th seeker of Truth
 
Join Date: Feb 2011
Posts: 50
Thanks: 0
Thanked 2 Times in 2 Posts
Contact Info
Send a message via Yahoo to ezennaemeka
Default Re: How much time Google bot takes to crawl a site?

guys pls don't mind my above mistake o!

ezennaemeka is offline   Reply With Quote
Old 01-14-2012, 11:18 AM   #6
HyperActive Warrior
 
simontts's Avatar
 
Join Date: Aug 2010
Location: UK
Posts: 120
Thanks: 13
Thanked 23 Times in 12 Posts
Default Re: How much time Google bot takes to crawl a site?

The quickest way I have found to get a new site (or new page or new post) crawled is to use Linklicious - typically it gets crawled within 24 hours of submitting the url.

simontts is offline   Reply With Quote
Old 01-14-2012, 11:53 AM   #7
Active Warrior
 
Join Date: Sep 2011
Posts: 56
Thanks: 0
Thanked 7 Times in 6 Posts
Default Re: How much time Google bot takes to crawl a site?

Have your site analyzed by Qirina and Googlebot will visit your site in short order.

www.qirina.com - FREE Keyword Intelligence to fix your on-site SEO and learn about your neighbors
Ronno99 is offline   Reply With Quote
Old 01-17-2012, 06:08 AM   #8
SEO Mindset
War Room Member
 
octavyo's Avatar
 
Join Date: Jun 2009
Posts: 172
Blog Entries: 1
Thanks: 20
Thanked 101 Times in 21 Posts
Contact Info
Send a message via Yahoo to octavyo Send a message via Skype™ to octavyo
Default Re: How much time Google bot takes to crawl a site?

It depends from site to site. Sometimes it takes one day (or even less in some cases) and sometimes will take several days. It`s not a written rule.

The good news is you can speed up this process by submiting your RSS feed to as many RSS directories you can found, do some social bookmarking, article marketing etc.

Also it`s good to submit your site map too. If your website is build using Wordpress you can do this in a few seconds from the dashboard panel.

I hope this helps you !

octavyo is offline   Reply With Quote
Old 01-17-2012, 07:14 AM   #9
Advanced Warrior
War Room Member
 
owenlee's Avatar
 
Join Date: Jul 2009
Posts: 940
Thanks: 0
Thanked 65 Times in 56 Posts
Default Re: How much time Google bot takes to crawl a site?

It should be SUPER fast as you can see from the results they returned in the search engine...

owenlee is online now   Reply With Quote
Old 01-17-2012, 08:09 AM   #10
HyperActive Warrior
 
bermuda's Avatar
 
Join Date: Mar 2010
Posts: 235
Thanks: 1
Thanked 16 Times in 16 Posts
Default Re: How much time Google bot takes to crawl a site?

Your question can be answered from two perspectives; the first one involves the plans or techniques which can be used to encourage Googlebot visiting your website more often, because sometimes even when a new site is launched, Google may not visit it for some days or even weeks due to various reasons, while the second aspect would be connected to how long it takes before all parts of your site get crawled by the Google program and these are tow different issues.

By building links for your website and at the same time adding fresh contents to it, gradually the Googlebot will be hitting your server and crawling the pages more frequently, leading to faster indexing and better crawling. On the other hand, the same two factors, links combined with contents, will help your entire website and all of its pages to get accessed and refreshed by Google better, deeper and faster. Do not forget to add contents to your site and build strong links for that.

bermuda is offline   Reply With Quote
Reply

  WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum

Tags
bot, crawl, google, site, takes, time

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off



All times are GMT -6. The time now is 02:40 PM.