difference between dissallws in robots.txt

3 replies
  • WEB DESIGN
  • |
hi

what is The difference between dissallows


/folder

and
/folder/
#difference #dissallws #robotstxt
  • Profile picture of the author Patrick
    I think this is more of a "SEO question" so posting in the seo forum might get results and feedback faster and better.
    {{ DiscussionBoard.errors[7663331].message }}
    • Profile picture of the author javadth
      Originally Posted by schwarzes View Post

      I think this is more of a "SEO question" so posting in the seo forum might get results and feedback faster and better.
      is the seo forum in warrior ?
      {{ DiscussionBoard.errors[7683917].message }}
  • Profile picture of the author David V
    Originally Posted by javadth View Post

    hi

    what is The difference between dissallows

    /folder

    and
    /folder/
    Within the context of the question, I wouldn't say this is an seo question, if I'm wrong, I'll accept the thrashing from Istvan.

    The first one:
    /folder
    will not protect the folder.

    The second one:
    /folder/
    will protect the folder.

    Here's just a couple quick examples:

    Disallow indexing of everything
    User-agent: *
    Disallow: /
    Disallow indexing of a specific folder
    User-agent: *
    Disallow: /folder/
    Disallow indexing of a folder, except for allowing the indexing of one file in that folder
    User-agent: *
    Disallow: /folder/
    Allow: /folder/singlepage.html
    Disallow your search page url from being indexed
    User-agent: *
    Disallow: /?s=
    and this just scratches the surface of what you can do....
    {{ DiscussionBoard.errors[7685658].message }}

Trending Topics