2 {{ upvoteCount | shortNum }}
2 {{ upvoteCount | shortNum }}

Use of Disallow: /*.html/feed

by neha12
1 replies
  • SEO
    • |
Hello Warriors,

I am unable to understand this code "Disallow: /*.html/feed" under robots.txt file.

My website's feed is opening like this "mywebsite.com/feed". I want to know, is this code useful for my website? Or i need to change it?

Please explain me the meaning/use of this code. Why peoples use this code and what files on my server it will restrict.

I am expecting a useful reply by forum's warriors.
#disallow #or html or feed
  • Profile picture of the author Joshua Lowenthal
    That is a little confusing I must say. Let me explain a little.

    The Robots.txt file on your server is what web-crawling robots, like that used by the Big G to index and subsequently rank your website, use this file to determine where they can go and what they can index in your website.

    The Disallow command acts as a rule that the robot must follow. It disallows them from looking at what is specified.

    Now usually a disallow command is accompanied by folder directories and/or file names.

    Things like:
    Disallow /this/is/a/folder

    or

    Disallow /this/is/a/file.html

    However from what you put it almost is Disallowing all .html files from being indexed.

    Now a senior developer will chime in here soon and either verify that is what it is doing, or if it is even possible, or tell you that it isn't possible.

    As of right now though if it is what it is doing than Google will not be able to index any .html files on your website.

    I hope I am wrong about this however.
    {{ DiscussionBoard.errors[7551746].message }}

Trending Topics