Robots, Wordpress and Duplicate Content
- SEO |
Wordpress and all its subdirectories are new to me.... Is there a standard robots.txt people use when they use wordpress so that only the pages and posts are indexed?
So far I've got:
User-agent: *
Disallow: /wp-
Disallow: /feed/
Disallow: /trackback/
Disallow: /cgi-bin/
But think I should also have
Disallow: /tag/
Disallow: /category/
Disallow: /author/
Disallow: /admin/
And something for archives... /archives/? Maybe?
Any suggestions?
Thanks,
Stephen
-
Intrepreneur -
Thanks - 1 reply
SignatureSEO, copywriting and backlinks service UK{{ DiscussionBoard.errors[1442993].message }}-
Cristian Lungu -
Thanks
{{ DiscussionBoard.errors[1447012].message }} -
-
-
tony-raymondo -
Thanks - 1 reply
{{ DiscussionBoard.errors[1447190].message }}-
Beldin -
Thanks
{{ DiscussionBoard.errors[1451835].message }} -
-