 |
| ||||||||
 |
|||||||||
 |
|
|||||||
 |
|
|
LinkBack | Thread Tools |
06-26-2009, 02:47 AM
|
#1 |
|
HyperActive Warrior
Join Date: May 2009
Posts: 264
Thanks: 24
Thanked 19 Times in 17 Posts
|
How to avoid an entire site being Google Indexed?
Hey warriors,
I have a domain where I upload personal photos and documents which are only meant to be viewed by family members. Obviously, I'd like the entire site to NOT be indexed by Google. I figured that if I moved the entire site into a password-protected folder like www.MyDomain.com/family/ , being "family" the password-protected folder, Google bots would not be able to index any content within. Is that correct? I just don't want anyone to be able to access (or even to be aware of) the contents unless he/she has the family password. Thanks! |
|
    
|
|
06-26-2009, 02:52 AM
|
#2 |
|
Marketing Mogul
Join Date: Jun 2009
Location: St. Louis
Posts: 8
Thanks: 0
Thanked 3 Times in 2 Posts
|
Re: How to avoid an entire site being Google Indexed?
Even if they could spider it (which they shouldn't be able to if you set the permissions correctly), they couldn't see anything because you'd have to log in.
|
|
|
|
|
06-26-2009, 02:55 AM
|
#3 |
|
Newbie Warrior
Join Date: Apr 2009
Location: The Tropics
Posts: 248
Thanks: 31
Thanked 9 Times in 9 Posts
|
Re: How to avoid an entire site being Google Indexed?
I think the password will take care of it. They would be aware of your domain, and the family folder, but beyond that only those who has the password can access it.
|
|
hates the rain
|
|
|
|
|
|
06-26-2009, 03:00 AM
|
#4 | |
|
Veteran Marketing Warrior
War Room Member
Join Date: Jun 2009
Posts: 612
Thanks: 21
Thanked 78 Times in 62 Posts
|
Re: How to avoid an entire site being Google Indexed?
Quote:
Alternatively you can instruct the 'bots through "robots.txt" or .htaccess. You can of course create a password access as has already been metioned though cPanel or .htaccess. | |
|
|
|
|
06-26-2009, 03:05 AM
|
#5 |
|
HyperActive Warrior
War Room Member
Join Date: Jan 2008
Location: Southern California
Posts: 167
Thanks: 8
Thanked 44 Times in 30 Posts
|
Re: How to avoid an entire site being Google Indexed?
In addition to password protecting the directory, I believe you can also create a robots.txt file with the following two lines in it.
User-agent: * Disallow: / Upload that to the root directory and that should also tell the spiders not to index any part of the site. At least in theory... Wendell |
|
|
|
|
|
|
|
06-26-2009, 05:01 AM
|
#6 |
|
HyperActive Warrior
Join Date: May 2009
Location: at the edge of the world
Posts: 421
Blog Entries: 1
Thanks: 34
Thanked 15 Times in 15 Posts
|
Re: How to avoid an entire site being Google Indexed?
You have to disallow indexing via robots.txt of that page...... then goolge will not idex it.....
|
|
|
|
|
|
|
|
06-26-2009, 08:39 AM
|
#7 |
|
Senior Warrior Member
War Room Member
Join Date: Apr 2006
Location: , , USA.
Posts: 1,708
Thanks: 17
Thanked 41 Times in 40 Posts
|
Re: How to avoid an entire site being Google Indexed?
The only way to not be index by any search engine is to password protect the folder.
|
|
|
|
|
06-26-2009, 08:53 AM
|
#8 |
|
Warrior Member
Join Date: Jun 2009
Posts: 14
Thanks: 0
Thanked 0 Times in 0 Posts
|
Re: How to avoid an entire site being Google Indexed?
quick check is to do a search on site:yourdomain.com and check what search engines have picked up already. If your havnt already applied a password file which will resolve this then the spiders may have already indexed your site and therefore stored a cache of this. worth checking
|
|
Chris Smith
SEO Consultant & Internet Stratagist Affordable SEO | Yahoo SEO | Search Engine Optimisation |
|
|
|
|
|
|
| Tags |
| avoid, entire, google, indexed, site |
| Thread Tools | |
|
|
 |
