4 {{ upvoteCount | shortNum }}
4 {{ upvoteCount | shortNum }}

Robot txt template for wordpress

by jaykay192
3 replies
  • SEO
    • |
Hi all,
I have been advise that my previous robot text was rubbish, yet most of the information was taken from the websites regarding the best seo practises for wordpress. I would like to know on your thoughts of the best template robot txt disallows / allows / no index for wordpress websites?
Thank you
#robot #template #txt #wordpress
  • Profile picture of the author fpforum
    Well obviously your site needs to allow the search spiders to access it if you want to rank. The only time I think you would really need to worry about setting up a robots would be if there were particular directories/images/files that you didn't want indexed. If you want everything to be found and indexed by Google then I don't think a robots.txt is really necessary. Is there any particular file or folder that you do not want indexed?
    Signature
    Free SEO Software - Start Improving Your Rankings Today!
    Windows VPS Servers - Cheap Windows VPS Servers With Instant Setup!
    {{ DiscussionBoard.errors[10843576].message }}
  • Profile picture of the author yukon
    Banned
    I have no idea why anyone would even attempt to block a category page from Google SERPs.

    It's like throwing away traffic just because you can.

    Good luck with that.
    {{ DiscussionBoard.errors[10844014].message }}
  • Profile picture of the author ThomasHarvey
    What is all the dfd.name stuff?

    You could just disallow it all by doing:

    Disallow: /*dfd.name
    {{ DiscussionBoard.errors[10844083].message }}

Trending Topics