4 {{ upvoteCount | shortNum }}
4 {{ upvoteCount | shortNum }}

"url blocked by robots.txt"

by GGpaul
3 replies
  • SEO
    • |
I'm sure this has been brought up multiple times, but HOW does this happen? "url blocked by robots.txt"

So we can just log into Google Webmaster tools and we get something like that? Any motives that causes that? Is it the owner of the sites fault? Or is it some random person online trying to do some shady crap?
#url blocked by robotstxt
  • Profile picture of the author yukon
    Banned
    Might be a NOINDEX tag causing the problem, PM sent.
    {{ DiscussionBoard.errors[7425628].message }}
    • Profile picture of the author GGpaul
      Originally Posted by yukon View Post

      Might be a NOINDEX tag causing the problem, PM sent.
      I removed all the internal link that was similar to that. Can you double check for me? (I don't know what you did with your tool lol).
      Signature

      RIP Dad Oct 14 1954 - Mar 14 2015.

      {{ DiscussionBoard.errors[7425735].message }}
  • Profile picture of the author MrShabir
    Originally Posted by GGpaul View Post

    I'm sure this has been brought up multiple times, but HOW does this happen? "url blocked by robots.txt"

    So we can just log into Google Webmaster tools and we get something like that? Any motives that causes that? Is it the owner of the sites fault? Or is it some random person online trying to do some shady crap?

    Hello Please check your website there will be a link like yourdomain.com/robots.txt.

    If you want to block any link then you can put that link in block section.
    If you want to unblock any link then you just remove that link from block are.robots.txt: Google follow this file to cowl your website. This file is instraction for Google.
    I hope you understand.
    Signature
    Classify - Classified Ads WordPress Theme : Start You Ads Business in a min.
    Classiera - Classified Ads WordPress Theme : Start Your Classified website with Classiera.
    BeTube Video WordPress Theme : A Biggest Theme for Video Blog and Magazine
    {{ DiscussionBoard.errors[7425754].message }}

Trending Topics