4 {{ upvoteCount | shortNum }}
4 {{ upvoteCount | shortNum }}

Massive bot and spider traffic; is it Normal or Should we worry?

by TPS2012
3 replies
  • SEO
    • |
When we did a detailed analysis of traffic on our website we realized that as high as 40% of traffic is from bots & spiders ranging from Googlebot , bingbot to some unheard of (we are logging user agents) Is this normal or is it harbinger to something? We also have noticed numerous requests to probing bots which simply look for URLs with login.php or admin.php in all possible permutations with domain URL. (Possibly curl based scripts) hitting at one request per second
Should we worry? Any insights on what is happening?
#bot #massive #normal #seo #spider #traffic #worry
  • Profile picture of the author aygabtu
    If you have 100's or 1000's of pages it is normal to see a lot of hits from bots, but anything probing for login.php or admin.php sounds like a malicious bot and I would block the IP.
    Signature

    Check top 300 Google SERP results free. WhatsMySERP.com tracks and graphs changes for multiple domains/keywords/regions. Also includes advanced keyword density tool.

    {{ DiscussionBoard.errors[8343656].message }}
  • Profile picture of the author vk3
    Is this a WordPress installation?

    If so, locking down your blog with a bit more security would definitely be useful - I've used the free plug-in "Better WP Security" (link) on more than a dozen of my sites; it seems to cut down on hacking and injections tremendously - although, make sure to do a little research beforehand, so you know what features you're turning on (and off).
    {{ DiscussionBoard.errors[8343781].message }}
  • Profile picture of the author Marketaire
    Definitely hit some security up mate. Queries surrounding those types of pages certainly isn't natural, particularly with pages/values strung together at the tail end.
    {{ DiscussionBoard.errors[8343794].message }}

Trending Topics