10 {{ upvoteCount | shortNum }}
10 {{ upvoteCount | shortNum }}

Can I use the Robots Txt to keep an entire webside unindexed?

by AprilCT
8 replies
I'm going to be taking the plunge in the near future to do a website and get hosting.

I know very little about WordPress and want to play around doing things first to understand, hands on by personal experience and experimentation, so many things you need to be able to do.

Is there something I can do to keep the whole thing from being indexed until I learn how to handle it? I really don't want to look silly on the net---everybody will be starring at only me and the silly gaffes

If there is an answer, remember I need a really good, exacting explanation and the code to put on it, I know absolutely nothing about how to do this -- but determined to learn.
#entire #robots #txt #unindexed #webside
  • Profile picture of the author KenThompson
    Hi,

    Yes you can, and maybe this will make it easier for you. You don't
    have to add the code manually. It's a WP plugin.

    You want to use, noindex, for your pages. The nofollow refers to
    links.

    Meta Robots WordPress plugin - Yoast - Tweaking Websites


    Ken
    {{ DiscussionBoard.errors[2841603].message }}
  • Profile picture of the author AprilCT
    Thanks so much, I will follow up with that.
    {{ DiscussionBoard.errors[2841610].message }}
    • Profile picture of the author Pindich
      Hi

      Just To add to what Ken said, I would also do the following if I want to get some privacy. I do this for my training blogs.

      I would go to the settings tab in the wp dashboard and choose the option

      "I would like to block search engines but allow normal visitors"

      The logic here is that the way people find your page is if the page is indexed and can be accessed when people use appropriate keywords. if it is not accessed by the Search engines and therefore not indexed then people can find only if you give them the link or by total accident.


      Another thing I will do is disable pinging. so that as you play around trying different things your blog will not be pinging the different directories.

      I hope this information adds something that can help you.

      enjoy your training and good luck.
      Signature
      Could This IM Magazine Be Just What We Have Been Missing In The Industry?

      For Marketers Who Want To Take Action But Just Can't Start! Click Here
      {{ DiscussionBoard.errors[2841996].message }}
  • Profile picture of the author John Henderson
    AprilCT, just FYI, you can set up the entire wordpress install on your desktop machine. More info here... http://www.warriorforum.com/main-int...-computer.html
    {{ DiscussionBoard.errors[2842182].message }}
  • Profile picture of the author Tyrus Antas
    Just place a robots.txt file on your root directory with
    the following contents:

    User-agent: *
    Disallow: /

    As for looking silly, you have to worry about other
    things first: how will you get the traffic?

    Tyrus
    {{ DiscussionBoard.errors[2842233].message }}
    • Profile picture of the author AprilCT
      I truly appreciate the help here from all of you. Your help gives me great hope and confidence that learning WordPress will be successful

      ...just putting it on my computer and working with it there would probably solve my problem. That's terrific and a great idea...nobody will see all the mistakes!

      As for traffic, I want to block any possible avenues when learning WordPress. However, thanks to all the wonderful people here on WF who have shared, I know how to get traffic started.
      {{ DiscussionBoard.errors[2844198].message }}
  • Profile picture of the author Sam Rodrigo
    Hi,

    My suggestion is to have TWO WP installations like this

    http://www.myblogsite.xxx/install.
    and
    http://www.myblogsite.xxx/wptesting/ install.

    Then make the latter install a "no follow" area. As said above:

    User-agent: *
    Disallow: /wptesting/

    Then you can test all you want on one and keep the other clean.

    Success,
    Sam
    Signature
    RICH SAGE BLOG

    LOCAL AFFILIATE GOLD MINE:
    >> CLICK: BiiG NETWORK LAUNCH WSO     <<
    SIGN UP FREE. LIMITED NICHES/LOCATIONS!
    {{ DiscussionBoard.errors[2844220].message }}
  • Profile picture of the author jasonmorgan
    You're way over complicating things. It's built into wordpress already.

    Signature

    I'm all about that bass.

    {{ DiscussionBoard.errors[2844266].message }}

Trending Topics