7 {{ upvoteCount | shortNum }}
7 {{ upvoteCount | shortNum }}

Normal behavior for Googlebot?

by Michael Tracey
6 replies
  • SEO
    • |
For some time now Googlebot, Msnbot & yahooslurp have been literally sitting on my site
By sitting on my site I mean if I run my stats at 1.00am Google's last visit will be 0.59am
With the other 2 say 0.41am& 0.39am. Then if I run them at 3.00pm Googles last visit will be 2.55pm and an increase in megabytes(so it's been doing something) With Yahoo Slurp and MSN bot Being 2.54 & 2.40pm With increases of megabytes

This occurs any time of the day or night

What I want to know is this normal if so any idea as to the reason?

Michael
#behavior #googlebot #normal
  • Profile picture of the author Michael Tracey
    Nobody??

    Michael
    {{ DiscussionBoard.errors[1643344].message }}
  • Profile picture of the author Kwaku
    You mean that Googlebot (and others) are hammering your site? On my best sites (the sites that are growing the fastest) Googlebot and Slurp are passing by 2-3 times per second. It's a good thing.

    I know some people are limiting googlebot or even banning it because it is pulling down their servers; what morons they are.
    {{ DiscussionBoard.errors[1643382].message }}
  • Profile picture of the author GMD
    Banned
    Mike, this is a good thing. I had the same question for my website as well. I watched two or three bots just lurking. At first, I thought it must be the dreaded spammers. So I looked up the IPs and saw they were from Google. Then I did some research from there. I agree with the other post too: don't panic and "ban" them!

    As to why they are there so often and so long, is anybody's guess; but it has to be a good thing.
    {{ DiscussionBoard.errors[1648014].message }}
  • Profile picture of the author FeedbackSecrets
    If it is really Google, then I agree, it is a good thing. Those bots sitting on your site probably correlate with a high cache rate.
    Signature
    Tips for Job Hunting
    {{ DiscussionBoard.errors[1648840].message }}
  • Profile picture of the author DogScout
    With cloud computing, they have the power to have a replicated bot at every site on the web 24/7
    no biggie
    Signature
    {{ DiscussionBoard.errors[1649260].message }}
  • Profile picture of the author Mike Anthony
    Very good thing. the sites that google don't like are not indexed as often.
    Signature

    {{ DiscussionBoard.errors[1649292].message }}

Trending Topics