Go Back   WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum
Register Blogs FAQ Social Groups CalendarHelp Desk

Reply
 
Share
LinkBack Thread Tools
Old 10-08-2011, 10:30 AM   #1
Advanced Warrior
War Room Member
 
Karma Fencer's Avatar
 
Join Date: May 2011
Posts: 898
Thanks: 95
Thanked 155 Times in 59 Posts
Default How much time Google bot takes to crawl a site?

Hi everyone,
I want to know that How much time Google boot takes to crawl a site??
Kindly let me know if anyone have any information about that.
Thanks in advance.
Karma Fencer is offline   Reply With Quote
Old 10-08-2011, 10:32 AM   #2
HyperActive Warrior
War Room Member
 
d0rhk's Avatar
 
Join Date: Dec 2008
Location: Toronto, Canada
Posts: 352
Thanks: 93
Thanked 78 Times in 50 Posts
Default Re: How much time Google bot takes to crawl a site?

It probably takes the google bot milliseconds to crawl a site. The servers they deploy to do this are extremely high powered and on very fast dedicated connections. They probably crawl millions and millions of pages of content every day.
d0rhk is offline   Reply With Quote
Old 10-08-2011, 10:35 AM   #3
HyperActive Warrior
War Room Member
 
Join Date: Feb 2005
Location: Cheltenham, United Kingdom.
Posts: 393
Thanks: 115
Thanked 233 Times in 90 Posts
Default Re: How much time Google bot takes to crawl a site?

Unless your site is small it's unlikely they'll crawl it all in one session.

They are pretty "friendly" when they crawl your site and do their best not to slow it down for other users.

Their webmaster info is here: Changing Google's crawl rate - Webmaster Tools Help

trevord92 is offline   Reply With Quote
Old 10-08-2011, 10:56 AM   #4
ÜberActive Warrior
 
Buyseech's Avatar
 
Join Date: Oct 2010
Location: Slovenia
Posts: 332
Thanks: 38
Thanked 29 Times in 26 Posts
Social Networking View Member's FaceBook Profile  View Member's Twitter Profile  View Member's YouTube Profile
Contact Info
Send a message via Skype™ to Buyseech
Default Re: How much time Google bot takes to crawl a site?

Quote:
Originally Posted by FerencMakar View Post
Hi everyone,
I want to know that How much time Google boot takes to crawl a site??
Kindly let me know if anyone have any information about that.
Thanks in advance.
It is not clear from your question wether or not you are looking for the time (in miliseconds) it takes for it to crawl the site or how much time must pass before it gets to your site (i presume its a brand new site and not an authority site).

Big "authority" sites get crawled daily or even more times per day, but smaller sites can take up to a month (if not more) if there is no "action", backlinking etc.

I have wrote an entire post on this subject here -> How to get your website in google in under 30 minutes

Hope it helps.

Sincerely, Buyseech
Buyseech is offline   Reply With Quote
Old 10-08-2011, 12:34 PM   #5
Th seeker of Truth
 
Join Date: Feb 2011
Posts: 50
Thanks: 0
Thanked 2 Times in 2 Posts
Contact Info
Send a message via Yahoo to ezennaemeka
Default Re: How much time Google bot takes to crawl a site?

guys pls don't mind my above mistake o!

ezennaemeka is offline   Reply With Quote
Old 01-14-2012, 11:18 AM   #6
HyperActive Warrior
 
simontts's Avatar
 
Join Date: Aug 2010
Location: UK
Posts: 120
Thanks: 13
Thanked 24 Times in 12 Posts
Default Re: How much time Google bot takes to crawl a site?

The quickest way I have found to get a new site (or new page or new post) crawled is to use Linklicious - typically it gets crawled within 24 hours of submitting the url.

simontts is offline   Reply With Quote
Old 01-14-2012, 11:53 AM   #7
Active Warrior
 
Join Date: Sep 2011
Posts: 94
Thanks: 1
Thanked 14 Times in 11 Posts
Default Re: How much time Google bot takes to crawl a site?

Have your site analyzed by Qirina and Googlebot will visit your site in short order.

www.qirina.com - FREE Keyword Intelligence to fix your on-site SEO and learn about your neighbors
Now available in English and French
Ronno99 is offline   Reply With Quote
Old 01-17-2012, 06:08 AM   #8
SEO Mogul
War Room Member
 
octavyo's Avatar
 
Join Date: Jun 2009
Posts: 186
Blog Entries: 1
Thanks: 32
Thanked 115 Times in 24 Posts
Contact Info
Send a message via Yahoo to octavyo Send a message via Skype™ to octavyo
Default Re: How much time Google bot takes to crawl a site?

It depends from site to site. Sometimes it takes one day (or even less in some cases) and sometimes will take several days. It`s not a written rule.

The good news is you can speed up this process by submiting your RSS feed to as many RSS directories you can found, do some social bookmarking, article marketing etc.

Also it`s good to submit your site map too. If your website is build using Wordpress you can do this in a few seconds from the dashboard panel.

I hope this helps you !

octavyo is online now   Reply With Quote
Old 01-17-2012, 07:14 AM   #9
Senior Warrior Member
War Room Member
 
owenlee's Avatar
 
Join Date: Jul 2009
Posts: 1,216
Thanks: 1
Thanked 90 Times in 81 Posts
Default Re: How much time Google bot takes to crawl a site?

It should be SUPER fast as you can see from the results they returned in the search engine...
owenlee is online now   Reply With Quote
Old 01-17-2012, 08:09 AM   #10
HyperActive Warrior
 
bermuda's Avatar
 
Join Date: Mar 2010
Posts: 257
Thanks: 1
Thanked 18 Times in 18 Posts
Default Re: How much time Google bot takes to crawl a site?

Your question can be answered from two perspectives; the first one involves the plans or techniques which can be used to encourage Googlebot visiting your website more often, because sometimes even when a new site is launched, Google may not visit it for some days or even weeks due to various reasons, while the second aspect would be connected to how long it takes before all parts of your site get crawled by the Google program and these are tow different issues.

By building links for your website and at the same time adding fresh contents to it, gradually the Googlebot will be hitting your server and crawling the pages more frequently, leading to faster indexing and better crawling. On the other hand, the same two factors, links combined with contents, will help your entire website and all of its pages to get accessed and refreshed by Google better, deeper and faster. Do not forget to add contents to your site and build strong links for that.
bermuda is offline   Reply With Quote
Old 07-10-2012, 06:34 AM   #11
Active Warrior
 
Join Date: Dec 2011
Posts: 37
Thanks: 0
Thanked 1 Time in 1 Post
Default Re: How much time Google bot takes to crawl a site?

I think we can adjust the crawl visit in web master tool.

rvrathore is offline   Reply With Quote
Old 10-07-2012, 12:54 AM   #12
Active Warrior
 
Join Date: Sep 2012
Location: Pakistan
Posts: 46
Thanks: 0
Thanked 2 Times in 2 Posts
Default Re: How much time Google bot takes to crawl a site?

It takes different times on different sites depending on many factors like your site's page-rank. links to a page, how old your site is and maybe more factors.

Tricks Central - A blog on blogging tips, seo, social media and internet.

Play Angry Birds Free Online Play Angry Birds games online for free
irshad321 is offline   Reply With Quote
Old 10-07-2012, 06:15 AM   #13
Let's make $$$, together!
War Room Member
 
TomerN's Avatar
 
Join Date: Oct 2012
Location: Israel
Posts: 111
Thanks: 2
Thanked 15 Times in 14 Posts
Social Networking View Member's FaceBook Profile 
Contact Info
Send a message via Skype™ to TomerN
Default Re: How much time Google bot takes to crawl a site?

If you update your website every day with fresh content it will get crawled very quickly. If you update your website every once in a while it won't get crawled as often. Social bookmarking, especially through Twitter, Digg, and Reddit for some reason, helps sites get indexed and crawled very fast.

TomerN is offline   Reply With Quote
Reply

  WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum

Bookmarks

Tags
bot, crawl, google, site, takes, time

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off



All times are GMT -6. The time now is 05:53 AM.