4 {{ upvoteCount | shortNum }}
4 {{ upvoteCount | shortNum }}

test site uploaded, how to stop spiders picking it up?

by apples
3 replies
I am in the process of converting my site all into xsitepro pages.

I have uploaded it into a new folder called test

ei. /public_html/test

but now I have the old site + the new one within the "test" DIR folder.

I do not want google to pick up the new design that I am working on in case I get duplicate content penalty.

So what is the solution? Do I or can I use a no follow thing to block this specific folder and all its contents?

If so how and what would be the code?

Peter
#picking #site #spiders #stop #uploaded
  • Profile picture of the author Jay F
    Create a robots.txt file at the root of your server with the following

    User-agent: *
    Disallow: /test/
    Signature

    I'm working on some new things. So, nothing to promote just yet.

    {{ DiscussionBoard.errors[1971852].message }}
  • Profile picture of the author TheNightOwl
    Jay's got it.

    You could also password protect that directory in your cPanel while you're working on it so that only you have access to that section of the site.
    Signature
    {{ DiscussionBoard.errors[1971929].message }}
    • Profile picture of the author apples
      I already have this in my robots file

      User-agent: WebsiteOutlook
      Disallow: /

      Can I just add that to it so it looks like this?

      User-agent: WebsiteOutlook
      Disallow: /

      User-agent: *
      Disallow: /test/
      {{ DiscussionBoard.errors[1972041].message }}

Trending Topics