robots.txt for worpress

Gwuido65 · 08-18-2009, 11:09 AM

Hi there,

Just wondering if anybody would share their robots.txt file that they use for wordpress.

Looking for the most effective ones from an SEO point of view.

Thanks

Intrepreneur · 08-18-2009, 11:25 AM

Quote:

User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin/
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback/
Disallow: /feed/
Disallow: /reccommends/
Disallow: /comments
Disallow: */trackback
Disallow: */feed
Disallow: */comments
Disallow: /*?*
Disallow: /*?
Disallow: /training
Disallow: /training/courses
Allow: /wp-content/uploads

# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*

# Google AdSense
User-agent: Mediapartners-Google*
Disallow:
Allow: /*

Sitemap: http://www.yoursite.com/sitemap.xml

That's what I use

08-18-2009, 11:09 AM	#1
Gwuido65 HyperActive Warrior Join Date: Dec 2008 Location: United Kingdom Posts: 276 Thanks: 36 Thanked 13 Times in 5 Posts	robots.txt for worpress Hi there, Just wondering if anybody would share their robots.txt file that they use for wordpress. Looking for the most effective ones from an SEO point of view. Thanks
	Premium Weight Loss Supplements - Looking to lose weight once and for all? Try our high quality supplements, developed by one of the worlds leading nutritional scientists Follow me on Twitter