4 {{ upvoteCount | shortNum }}
4 {{ upvoteCount | shortNum }}

What have I done wrong in my robots?

by oliverjones
3 replies
  • SEO
    • |
I have some old urls which I want google to remove from the index so I have made a robots.txt file here http://www.hellohedgehog.com/robots.txt

For some reason when I check this in google webmaster tools it is telling me it can still access the pages I have said to disallow. Any help would be appreciated.
#robots #wrong
  • Profile picture of the author leavewizard
    Have you resolved this?
    I found Bing webmaster tools to be more helpful in sorting out my issue with robots.txt
    {{ DiscussionBoard.errors[6929473].message }}
  • Profile picture of the author DNAWRealm
    Banned
    Try removing those pages from the Google index via WMT or make them nofollow / noindex
    {{ DiscussionBoard.errors[6929551].message }}
  • Profile picture of the author jamaks
    Hi, not certain but I believe that if you remove the first (empty) disallow it would work correctly. I know you should not have an empty line and this may qualify as such. In fact it is more likely that the robot is reading the first line as disallow none and not reading it any further. Jim
    Signature

    jamaks

    {{ DiscussionBoard.errors[6929921].message }}

Trending Topics