Normal behavior for Googlebot?

by 6 replies
7
For some time now Googlebot, Msnbot & yahooslurp have been literally sitting on my site
By sitting on my site I mean if I run my stats at 1.00am Google's last visit will be 0.59am
With the other 2 say 0.41am& 0.39am. Then if I run them at 3.00pm Googles last visit will be 2.55pm and an increase in megabytes(so it's been doing something) With Yahoo Slurp and MSN bot Being 2.54 & 2.40pm With increases of megabytes

This occurs any time of the day or night

What I want to know is this normal if so any idea as to the reason?

Michael
#search engine optimization #behavior #googlebot #normal
  • Nobody??

    Michael
  • You mean that Googlebot (and others) are hammering your site? On my best sites (the sites that are growing the fastest) Googlebot and Slurp are passing by 2-3 times per second. It's a good thing.

    I know some people are limiting googlebot or even banning it because it is pulling down their servers; what morons they are.
  • Banned
    Mike, this is a good thing. I had the same question for my website as well. I watched two or three bots just lurking. At first, I thought it must be the dreaded spammers. So I looked up the IPs and saw they were from Google. Then I did some research from there. I agree with the other post too: don't panic and "ban" them!

    As to why they are there so often and so long, is anybody's guess; but it has to be a good thing.
  • If it is really Google, then I agree, it is a good thing. Those bots sitting on your site probably correlate with a high cache rate.
  • With cloud computing, they have the power to have a replicated bot at every site on the web 24/7
    no biggie
  • Very good thing. the sites that google don't like are not indexed as often.
Join the discussion

Next Topics on Trending Feed

  • 7

    Normal behavior for Googlebot?

    For some time now Googlebot, Msnbot & yahooslurp have been literally sitting on my site By sitting on my site I mean if I run my stats at 1.00am Google's last visit will be 0.59am With the other 2 say 0.41am& 0.39am. Then if I run them at 3.00pm Googles last visit will be 2.55pm and an increase in megabytes(so it's been doing something) With Yahoo Slurp and MSN bot Being 2.54 & 2.40pm With increases of megabytes