How can I prove a website is blocking ahref bots

4 replies
  • SEO
  • |
Hi there,

I am working for a client whos site is ranking well but not as well as the main competitor.

I know this competitor is blocking ahrefs from crawling their site. My client is getting frustrated because on ahrefs his site looks better, more backlinks etc.

How can I show him that the ahrefs report is not accurate and the competitors are hiding the backlinks?

Thanks
#ahref #blocking #bots #prove #website
Avatar of Unregistered
  • Profile picture of the author cbpayne
    Check if they are blocking it in their robots.txt file
    {{ DiscussionBoard.errors[11563799].message }}
    • Profile picture of the author MikeFriedman
      Originally Posted by cbpayne View Post

      Check if they are blocking it in their robots.txt file
      It will only be blocked there if they are morons. If they are not morons and are blocking it, they will be doing it in the .htaccess file.
      Signature

      For SEO news, discussions, tactics, and more.
      {{ DiscussionBoard.errors[11563864].message }}
  • Profile picture of the author MikeFriedman
    Originally Posted by DaniP85 View Post

    Hi there,

    I am working for a client whos site is ranking well but not as well as the main competitor.

    I know this competitor is blocking ahrefs from crawling their site. My client is getting frustrated because on ahrefs his site looks better, more backlinks etc.

    How can I show him that the ahrefs report is not accurate and the competitors are hiding the backlinks?

    Thanks
    That's not how Ahrefs works.

    It doesn't matter if they are blocking Ahrefs or not on their site. That doesn't prevent Ahrefs from finding links pointing to their site. They would have to be blocking Ahrefs on the sites linking to them, which they can only do if they own those sites.

    Having "more" backlinks doesn't mean a thing, especially if most of the links are low quality and weak.
    Signature

    For SEO news, discussions, tactics, and more.
    {{ DiscussionBoard.errors[11563865].message }}
  • Profile picture of the author DABK
    If things worked the way you think they do, you'd merely use another site instead of ahrefs to look at their backlinsk, majesticseo, for instance.


    The other site is not ranking better because it has more backlinks, it is ranking better because it has more good backlinks.


    If your client's site has 10,000 crappy backlinks, a handful of good backlinks can get them to outrank your client.


    Think of backlinks in terms of dollars.


    Let's assign forum backlinks and all other links you can create yourself on other people's site a value of $0.01.


    To get $100 worth of backlink juice, you'd need 10,000 of those backlinks.


    Or, you could get a backlink from someone's homepage (or another page) that's got its own good backlinks.


    Different pages with good backlinks have different $ value.


    If you take the homepage of one of my sites, a backlink from there would be $5 (if forum backlinks and such are worth $0.01). If you get 21 backlinks like this one, you're ahead of the site that's got 10k forum and such backlinks.


    So, the way to look at it is not how many but how many and from where. I am betting your client's backlinks look a lot like this:


    domain-name.com//articles/sh/8xmokzkyrgap3df/AACDK_sX-Y0TgtpgXjL1dLo8a/Images






    [85;11563749]Hi there,

    I am working for a client whos site is ranking well but not as well as the main competitor.

    I know this competitor is blocking ahrefs from crawling their site. My client is getting frustrated because on ahrefs his site looks better, more backlinks etc.

    How can I show him that the ahrefs report is not accurate and the competitors are hiding the backlinks?

    Thanks[/QUOTE]
    {{ DiscussionBoard.errors[11563880].message }}
Avatar of Unregistered

Trending Topics