![]() | | ||||||||
| | #1 |
| Warrior Member Join Date: Oct 2010
Posts: 9
Thanks: 0
Thanked 0 Times in 0 Posts
|
Which is the better way to restrict Search Engines to index my Directory: "uploads" and the content in it? User-agent: * 1: Disallow: /httpdocs/php/uploads/ 2: User-agent: * Disallow: /php/uploads/ 3: User-agent: * Disallow: /uploads/ if I use /php/uploads/ will search engines not index my "PHP" Directory? |
| | |
| | |
| | #2 |
| Warrior Member Join Date: Oct 2010
Posts: 9
Thanks: 0
Thanked 0 Times in 0 Posts
|
Also, can I hide robots.txt file from visitors like if someone open the link "/httpdocs/robots.txt" but I dont want to show that which directory is most important but Search Engines can still read this robots txt file, is there any way? |
| | |
| | |
| | #3 |
| Warrior Member Join Date: Oct 2010
Posts: 4
Thanks: 0
Thanked 1 Time in 1 Post
|
I am looking for same stuff now a days if any have more idea about this then please mention here I am eagerly waiting for this .
|
| | |
| | |
| | #4 |
| Active Warrior Join Date: Oct 2010
Posts: 29
Thanks: 0
Thanked 2 Times in 2 Posts
|
They will index. You have to restrict for php folder too..
|
| | |
| | |
| | #5 |
| Senior Warrior Member Join Date: May 2009
Posts: 1,259
Thanks: 21
Thanked 54 Times in 52 Posts
|
Agree w/ the comment above - they should index, so you will have to restrict bots from indexing them. I believe the first one should work: User-agent: * Disallow: /httpdocs/php/uploads/ |
| | |
| | |
| | #6 |
| Active Warrior Join Date: Oct 2010 Location: cochin
Posts: 34
Thanks: 1
Thanked 2 Times in 2 Posts
|
Google will index robots.txt and sitemap files first so there is no way to hide these files from Google and the format for not crawling that 'upload' folder is Useragent : Google Disallow : /uploads |
| | |
| | |
| | #7 |
| Plundering the Web War Room Member Join Date: Feb 2007 Location: , , .
Posts: 4,849
Thanks: 804
Thanked 1,199 Times in 886 Posts
|
Put your uploads in a password protected folder. Google is not the only one indexing stuff... Paul |
| How to Make Money off Facebook: Login to your account. Deactivate your account. Get your butt to work.
| |
| | |
| | #8 |
| Warrior Member Join Date: Oct 2010
Posts: 9
Thanks: 0
Thanked 0 Times in 0 Posts
| |
| | |
| | |
![]() |
|
| Tags |
| file, quick, reply, robotstxt |
| Thread Tools | |
| |
![]() |