Normal behavior for Googlebot?

Michael Tracey · 01-19-2010, 12:48 AM

For some time now Googlebot, Msnbot & yahooslurp have been literally sitting on my site
By sitting on my site I mean if I run my stats at 1.00am Google's last visit will be 0.59am
With the other 2 say 0.41am& 0.39am. Then if I run them at 3.00pm Googles last visit will be 2.55pm and an increase in megabytes(so it's been doing something) With Yahoo Slurp and MSN bot Being 2.54 & 2.40pm With increases of megabytes

This occurs any time of the day or night

What I want to know is this normal if so any idea as to the reason?

Michael

Michael Tracey · 01-20-2010, 03:03 AM

Nobody??

Michael

Kwaku · 01-20-2010, 03:21 AM

You mean that Googlebot (and others) are hammering your site? On my best sites (the sites that are growing the fastest) Googlebot and Slurp are passing by 2-3 times per second. It's a good thing.

I know some people are limiting googlebot or even banning it because it is pulling down their servers; what morons they are.

GMD · 01-21-2010, 05:37 AM

Mike, this is a good thing. I had the same question for my website as well. I watched two or three bots just lurking. At first, I thought it must be the dreaded spammers. So I looked up the IPs and saw they were from Google. Then I did some research from there. I agree with the other post too: don't panic and "ban" them!

As to why they are there so often and so long, is anybody's guess; but it has to be a good thing.

FeedbackSecrets · 01-21-2010, 09:41 AM

If it is really Google, then I agree, it is a good thing. Those bots sitting on your site probably correlate with a high cache rate.

DogScout · 01-21-2010, 11:17 AM

With cloud computing, they have the power to have a replicated bot at every site on the web 24/7
no biggie

Mike Anthony · 01-21-2010, 11:27 AM

Very good thing. the sites that google don't like are not indexed as often.

01-19-2010, 12:48 AM	#1
Michael Tracey Ancient&Decrepit Warrior War Room Member Join Date: Jul 2002 Location: South Africa Posts: 4,378 Thanks: 71 Thanked 169 Times in 25 Posts	Normal behavior for Googlebot? For some time now Googlebot, Msnbot & yahooslurp have been literally sitting on my site By sitting on my site I mean if I run my stats at 1.00am Google's last visit will be 0.59am With the other 2 say 0.41am& 0.39am. Then if I run them at 3.00pm Googles last visit will be 2.55pm and an increase in megabytes(so it's been doing something) With Yahoo Slurp and MSN bot Being 2.54 & 2.40pm With increases of megabytes This occurs any time of the day or night What I want to know is this normal if so any idea as to the reason? Michael
	Africhef for great African Recipes Recipes Specially for South Africans For Those who like Okra And Yes we got some bananas

01-20-2010, 03:03 AM	#2
Michael Tracey Ancient&Decrepit Warrior War Room Member Join Date: Jul 2002 Location: South Africa Posts: 4,378 Thanks: 71 Thanked 169 Times in 25 Posts	Re: Normal behavior for Googlebot? Nobody?? Michael
	Africhef for great African Recipes Recipes Specially for South Africans For Those who like Okra And Yes we got some bananas

01-20-2010, 03:21 AM	#3
Kwaku Warrior Member War Room Member Join Date: Dec 2007 Location: , , . Posts: 29 Thanks: 1 Thanked 0 Times in 0 Posts	Re: Normal behavior for Googlebot? You mean that Googlebot (and others) are hammering your site? On my best sites (the sites that are growing the fastest) Googlebot and Slurp are passing by 2-3 times per second. It's a good thing. I know some people are limiting googlebot or even banning it because it is pulling down their servers; what morons they are.

01-21-2010, 05:37 AM	#4
GMD d.b.a. "PLAN B" War Room Member Join Date: Jan 2010 Location: Boston, MA Posts: 446 Thanks: 24 Thanked 250 Times in 120 Posts Contact Info	Re: Normal behavior for Googlebot? Mike, this is a good thing. I had the same question for my website as well. I watched two or three bots just lurking. At first, I thought it must be the dreaded spammers. So I looked up the IPs and saw they were from Google. Then I did some research from there. I agree with the other post too: don't panic and "ban" them! As to why they are there so often and so long, is anybody's guess; but it has to be a good thing.

01-21-2010, 09:41 AM	#5
FeedbackSecrets Active Warrior Join Date: Nov 2008 Posts: 47 Thanks: 1 Thanked 1 Time in 1 Post	Re: Normal behavior for Googlebot? If it is really Google, then I agree, it is a good thing. Those bots sitting on your site probably correlate with a high cache rate.
	Tips for Job Hunting

01-21-2010, 11:17 AM	#6
DogScout Self Unemployed War Room Member Join Date: Jun 2009 Location: Florida Posts: 2,339 Thanks: 697 Thanked 618 Times in 367 Posts Social Networking	Re: Normal behavior for Googlebot? With cloud computing, they have the power to have a replicated bot at every site on the web 24/7 no biggie
	Otis's Blog (Own The Internet, Silly) Breast Cancer Support - Breast Cancer Information Paint Shop Tubes - Free images - Free Graphics - Free Photos - 3D - Poser Tubes - Scrap Kits

01-21-2010, 11:27 AM	#7
Mike Anthony SEO D'Artagnan War Room Member Join Date: Aug 2009 Posts: 4,980 Thanks: 476 Thanked 1,090 Times in 701 Posts	Re: Normal behavior for Googlebot? Very good thing. the sites that google don't like are not indexed as often.
	The World's only Full ongoing, no limit, no question unanswered Mentorship on Building powerful SEO Networks reopened by popular demand for a short time.