3 {{ upvoteCount | shortNum }}
3 {{ upvoteCount | shortNum }}

robots.txt for WPMU

by PlumGreekMob
2 replies
is this correct for disallowing all directorys that contain /page/, /tag/, and /category/ ?


Disallow: */page/
Disallow: */tag/
Disallow: */category/


Reason i ask is because my WPMU is set up like blogstick.com/blog/ instead of the usual blog.blogstick.com and what i am trying to do is make sure that
blogstick.com/ANY-BLOG-ID/page/
blogstick.com/ANY-BLOG-ID/tag/
blogstick.com/ANY-BLOG-ID/category/

will not be crawled or indexed.


Thanks alot!
#robotstxt #wpmu
  • Profile picture of the author rufaswan
    Disallow: */page/

    This code will only block...

    blogstick.com/ANY-BLOG-ID/page/

    ...and won't work with...

    blogstick.com/ANY-BLOG-ID/page/post-title

    Change it into...

    Disallow: */page/*

    ...to block any URL with /page/ in it.

    - Rufas
    {{ DiscussionBoard.errors[1578254].message }}
    • Profile picture of the author PlumGreekMob
      Sweet, Just what i was looking for!
      Thanks given!


      Originally Posted by rufaswan View Post

      Disallow: */page/

      This code will only block...

      blogstick.com/ANY-BLOG-ID/page/

      ...and won't work with...

      blogstick.com/ANY-BLOG-ID/page/post-title

      Change it into...

      Disallow: */page/*

      ...to block any URL with /page/ in it.

      - Rufas
      Signature
      CPAlead Forum Learn how to make money like the Big Dogs.
      {{ DiscussionBoard.errors[1578933].message }}

Trending Topics