Is your host blocking SEMrush?

by 3 replies
4
Many people on this forum use SEMrush. It seems the SEMrush bot is blocked or blacklisted by some hosts.

Most of the hosts are owned by EIG aka Endurance International Group - about 84 at time of this writing. To be certain it is necessary to contact your host support in the event of changes.

Two popular hosts and hosting packages recommended on this forum and others owned by EIG are BlueHost and HostGator - Shared Hosting. To see if your host is owned by EIG you can reference this article EIG list (not affiliated).

You can read more about it on Reddit (not affiliated):
FYI SEMrush bot is blacklisted by Bluehost server

A SEMrush representative confirmed it and basically says the SEMrush bot is blocked by the web host on shared hosting packages and they have tried to contact EIG, but EIG will not respond:
Some reddit users say they have contacted their respective host and verified the block owed to heavy server usage. Personally, sounds fair enough to me. It should be noted that SEMrush does in fact explain how to un-block the bot with the robots.txt file and there are a few WordPress plugins designed to do the same, however when a host blocks a bot (or anything for that fact) that will override the robots.txt file, so No Joy.

There are many a thread on this forum wherein some SEO Agencies recommend SEMrush to their clients. There are also many SEO Agencies that do "not" recommend SEMrush. There are also many a member that recommend SEMrush. There are also many a member that do "not" recommend SEMrush.

In my experience the main reason some (not all) SEO Agencies recommend SEMrush is because it gives the SEO Agency a reference to a metric that the customer is lead to believe as proof of the SEO Agency's competence.

Now that it is verified by some web host support staff (according to some reddit members) the SEMrush bot is blocked/blacklisted will SEO Agencies stop recommending SEMrush?

If SEO Agencies stop using SEMrush what are the alternitives and will the alternatives eventually be blocked by web hosts?
#search engine optimization #blacklisted #blocking #bot #host #semrush
  • [DELETED]
  • Banned
    [DELETED]
    • [1] reply
    • That is not the point. This is about hosts blocking the MOZ Bot.
  • I would imagine from a host standpoint, it would make sense to block such tools, it does nothing for the host other than to consume BW, in other words, someone is spying on a site, and the host pays for it or someone has too, and I suspect a lot of similar tools are simply used to spy on the competition and to be honest, there is really nothing in it for the host other than it consumes data and resources.
    • [1] reply
    • In this case the website owner is not spying on their own site because the website owner authorized the MOZ Bot.

      The take away is more about the host blocking MOZ bot(s).
  • [DELETED]

Next Topics on Trending Feed

  • 4

    Many people on this forum use SEMrush. It seems the SEMrush bot is blocked or blacklisted by some hosts. Most of the hosts are owned by EIG aka Endurance International Group - about 84 at time of this writing. To be certain it is necessary to contact your host support in the event of changes.