robots.txt for worpress

1 replies
  • SEO
  • |
Hi there,

Just wondering if anybody would share their robots.txt file that they use for wordpress.

Looking for the most effective ones from an SEO point of view.

Thanks
#robotstxt #worpress
  • Profile picture of the author Intrepreneur
    User-agent: *
    Disallow: /cgi-bin
    Disallow: /wp-admin/
    Disallow: /wp-includes
    Disallow: /wp-content/plugins
    Disallow: /wp-content/cache
    Disallow: /wp-content/themes
    Disallow: /trackback/
    Disallow: /feed/
    Disallow: /reccommends/
    Disallow: /comments
    Disallow: */trackback
    Disallow: */feed
    Disallow: */comments
    Disallow: /*?*
    Disallow: /*?
    Disallow: /training
    Disallow: /training/courses
    Allow: /wp-content/uploads


    # Google Image
    User-agent: Googlebot-Image
    Disallow:
    Allow: /*

    # Google AdSense
    User-agent: Mediapartners-Google*
    Disallow:
    Allow: /*

    Sitemap: http://www.yoursite.com/sitemap.xml
    That's what I use
    {{ DiscussionBoard.errors[1093386].message }}

Trending Topics