8 {{ upvoteCount | shortNum }}
8 {{ upvoteCount | shortNum }}

How to avoid an entire site being Google Indexed?

by Anonymous Affiliate
7 replies
  • SEO
    • |
Hey warriors,

I have a domain where I upload personal photos and documents which are only meant to be viewed by family members. Obviously, I'd like the entire site to NOT be indexed by Google.

I figured that if I moved the entire site into a password-protected folder like www.MyDomain.com/family/ , being "family" the password-protected folder, Google bots would not be able to index any content within.

Is that correct? I just don't want anyone to be able to access (or even to be aware of) the contents unless he/she has the family password.

Thanks!
#avoid #entire #google #indexed #site
  • Profile picture of the author bryanclark
    Even if they could spider it (which they shouldn't be able to if you set the permissions correctly), they couldn't see anything because you'd have to log in.
    {{ DiscussionBoard.errors[916748].message }}
  • Profile picture of the author ken_p
    I think the password will take care of it. They would be aware of your domain, and the family folder, but beyond that only those who has the password can access it.
    {{ DiscussionBoard.errors[916759].message }}
    • Profile picture of the author WendellC
      In addition to password protecting the directory, I believe you can also create a robots.txt file with the following two lines in it.

      User-agent: *
      Disallow: /

      Upload that to the root directory and that should also tell the spiders not to index any part of the site.

      At least in theory...

      Wendell
      Signature

      List your no opt-in product here for free: No Opt In Required

      {{ DiscussionBoard.errors[916773].message }}
  • Profile picture of the author Adrian Cooper
    Originally Posted by Anonymous Affiliate View Post

    Hey warriors,

    I have a domain where I upload personal photos and documents which are only meant to be viewed by family members. Obviously, I'd like the entire site to NOT be indexed by Google.

    I figured that if I moved the entire site into a password-protected folder like www.MyDomain.com/family/ , being "family" the password-protected folder, Google bots would not be able to index any content within.

    Is that correct? I just don't want anyone to be able to access (or even to be aware of) the contents unless he/she has the family password.

    Thanks!
    You can use the "nocache" and "noindex" tags as well as "nofollow" in your headers to instruct Google to stay away.

    Alternatively you can instruct the 'bots through "robots.txt" or .htaccess.

    You can of course create a password access as has already been metioned though cPanel or .htaccess.
    {{ DiscussionBoard.errors[916767].message }}
  • Profile picture of the author Amenda Jessera
    You have to disallow indexing via robots.txt of that page...... then goolge will not idex it.....
    {{ DiscussionBoard.errors[917005].message }}
  • Profile picture of the author KirkMcD
    The only way to not be index by any search engine is to password protect the folder.
    {{ DiscussionBoard.errors[917591].message }}
  • Profile picture of the author seo-authority
    quick check is to do a search on site:yourdomain.com and check what search engines have picked up already. If your havnt already applied a password file which will resolve this then the spiders may have already indexed your site and therefore stored a cache of this. worth checking
    {{ DiscussionBoard.errors[917641].message }}

Trending Topics