6 {{ upvoteCount | shortNum }}
6 {{ upvoteCount | shortNum }}

robot.txt help

by royalgalaxy
5 replies
  • SEO
    • |
I need help on robot.txt as i have a new site and would like some google robots to visit my site :p... how do I create a robot.txt file for wordpress ..what do I write inside robot.txt ??

thanks
#robottxt
  • Profile picture of the author timpears
    I think WordPress creates a robots.txt file automatically.

    Robots.txt is not to get Google robots to visit your site, it is rto prevent the robots from viewing some files. Best thing I do when I need to create a robots.txt file is Google it and follow the directions. I can't remember exactly how to do it, so that is what i do and it works out quite well. https://www.google.com/#bav=on.2,or....s.txt&safe=off
    Signature

    Tim Pears

    {{ DiscussionBoard.errors[8383937].message }}
  • Profile picture of the author royalgalaxy
    means robot.txt is meant to block pages ??
    {{ DiscussionBoard.errors[8400422].message }}
  • Profile picture of the author webdevpro
    Yes, robots.txt is to control which pages should NOT be visited but the reverse is not true as by default all the pages will be crawled and indexed so no need to mention those explicitly.
    Signature
    {{ DiscussionBoard.errors[8400630].message }}
  • Profile picture of the author TheContentAuthority
    Royalgalaxy,

    To add to what timpears said, also note that search engines (while not typical) can also choose to ignore the robots file.

    Best,

    Shawn
    Signature
    Outsource to the experts...

    We customize your Blog, eBook, Press Release and Sale Copy content with your message.

    {{ DiscussionBoard.errors[8400716].message }}
    • Profile picture of the author timpears
      Originally Posted by TheContentAuthority View Post

      Royalgalaxy,

      To add to what timpears said, also note that search engines (while not typical) can also choose to ignore the robots file.

      Best,

      Shawn
      Yes, absolutely, robots.txt is only a request the bot leave those pages alone. They can and do ignore the request.
      Signature

      Tim Pears

      {{ DiscussionBoard.errors[8402059].message }}

Trending Topics