Hiding the Good Stuff so Visitors HAVE to Subscribe!

EndGame · 08-30-2008, 05:42 PM

Hi gang,

I'm waiting on the golden card of magic to arrive (my Paypal topup card) and I have got my finger on the getresponse button for when the card slips through my letterbox. Yes, I am going to get a P.O. box address and start my lists.

My question is, if I have some pages of content that I don't want to be indexed in the big G and other search engines what do I do? Is it a robots.txt file? What if I only want to stop specific pages being indexed? I don't understand the robots.txt concept too well, does that only allow you to hide the entire website? I've done some research on it but haven't found any useful "step-by-step for idiots" tutorials which I might need.

I want to keep specific pages safe and secret from SE's because I only want my subscribers to see them.

Can anyone jump in and "help a brother out?"

Thanks in advance.

Alex

Gary Huynh · 08-30-2008, 06:02 PM

Putting all your pages that you want protected inside a directory and password protect that directory is another option if you don't want to mess with the robots.txt file.

Here is how to protect certain directories from being crawled and indexed:
How to stop search engines from indexing your pages | Bite Size Standards

EndGame · 08-30-2008, 06:10 PM

Thanks very much. Stupid question....... what are people referring to when they say "directories" when talking about robots.txt?

Louis Raven · 08-30-2008, 06:30 PM

Hi,

If you only want your subscribers to see them then you can't expect any traffic/love from Google.

You can either password protect a directory (website/pages) using free and/or paid membership scripts/ services.

Or, you can add a NoIndex meta tag to each individual page you don't want google to index. But, using the meta tag method will only keep google bots out and stop them from indexing your stuff. If someone types the URL they can still see the content.

Amember.com is a membership service that keeps prying eyes away but is very costly for "most". There's other free ways to password protect your site but I'm not sure on there effectiveness.

PM if you need more info.

Louis

ExRat · 08-30-2008, 06:39 PM

Hi,

Quote:

Thanks very much. Stupid question....... what are people referring to when they say "directories" when talking about robots.txt?

Directory means the same as 'folder' in terms of stuff on your hosting account. In this instance, they mean put the files in a folder (aka directory) and password protect it.

EndGame · 08-31-2008, 08:46 AM

Thanks everyone for the help. Its been very sueful, far more useful than my hosting's 24/7 support, who told me I'd need to contact Google if I didn't want my page indexed.

lawton3920 · 08-31-2008, 08:55 AM

Quote:

Originally Posted by ExRat

Hi,

Directory means the same as 'folder' in terms of stuff on your hosting account. In this instance, they mean put the files in a folder (aka directory) and password protect it.

Good answer ExRat and yup that will do the trick alright.

Roy Carter · 08-31-2008, 09:02 AM

Alex - Check out DLGuard for the best way of protecting your stuff from prying eyes.

Roy

David-JP · 08-31-2008, 11:42 AM

There's 2 ways you can look at protected content.
Walled Garden - all content is protected, usually in its own directory.
Magazine Model - teaser text is shown, but the rest of the content is protected.

I've used amember to do both of these models, with wordpress or joomla handling the content on them. You can see my sig for a demo of a magazine model site.

David

08-30-2008, 05:42 PM	#1
EndGame theratracelab.com War Room Member Join Date: Dec 2007 Location: ,Newcastle Upon Tyne , United Kingdom. Posts: 957 Blog Entries: 6 Thanks: 450 Thanked 151 Times in 80 Posts Social Networking Contact Info	Hiding the Good Stuff so Visitors HAVE to Subscribe! Hi gang, I'm waiting on the golden card of magic to arrive (my Paypal topup card) and I have got my finger on the getresponse button for when the card slips through my letterbox. Yes, I am going to get a P.O. box address and start my lists. My question is, if I have some pages of content that I don't want to be indexed in the big G and other search engines what do I do? Is it a robots.txt file? What if I only want to stop specific pages being indexed? I don't understand the robots.txt concept too well, does that only allow you to hide the entire website? I've done some research on it but haven't found any useful "step-by-step for idiots" tutorials which I might need. I want to keep specific pages safe and secret from SE's because I only want my subscribers to see them. Can anyone jump in and "help a brother out?" Thanks in advance. Alex
	"Better a student of reality than a master of illusion" Live Case Study: How to Setup a Business in your Spare-Time, Generate Quality Traffic, Make Money Online and Escape the Rat Race

08-30-2008, 06:02 PM	#2
Gary Huynh www.sixfiguremarketer.com War Room Member Join Date: Jul 2003 Location: USA Posts: 566 Blog Entries: 2 Thanks: 12 Thanked 11 Times in 10 Posts Social Networking Contact Info	Mr Putting all your pages that you want protected inside a directory and password protect that directory is another option if you don't want to mess with the robots.txt file. Here is how to protect certain directories from being crawled and indexed: How to stop search engines from indexing your pages \| Bite Size Standards
	Unique software adds Popups to your PDF files for ultimate viral promotion...check it out here.

08-30-2008, 06:10 PM	#3
EndGame theratracelab.com War Room Member Join Date: Dec 2007 Location: ,Newcastle Upon Tyne , United Kingdom. Posts: 957 Blog Entries: 6 Thanks: 450 Thanked 151 Times in 80 Posts Social Networking Contact Info	Re: Mr Thanks very much. Stupid question....... what are people referring to when they say "directories" when talking about robots.txt?
	"Better a student of reality than a master of illusion" Live Case Study: How to Setup a Business in your Spare-Time, Generate Quality Traffic, Make Money Online and Escape the Rat Race

08-30-2008, 06:30 PM	#4
Louis Raven Elite Warrior Member War Room Member Join Date: Jun 2007 Location: United Kingdom. Posts: 2,876 Blog Entries: 1 Thanks: 211 Thanked 64 Times in 49 Posts Social Networking	Re: Mr Hi, If you only want your subscribers to see them then you can't expect any traffic/love from Google. You can either password protect a directory (website/pages) using free and/or paid membership scripts/ services. Or, you can add a NoIndex meta tag to each individual page you don't want google to index. But, using the meta tag method will only keep google bots out and stop them from indexing your stuff. If someone types the URL they can still see the content. Amember.com is a membership service that keeps prying eyes away but is very costly for "most". There's other free ways to password protect your site but I'm not sure on there effectiveness. PM if you need more info. Louis
	Web Graphics Design Internet Marketing Blog Baby Blog Babies What Is Anemia?

08-31-2008, 08:46 AM	#6
EndGame theratracelab.com War Room Member Join Date: Dec 2007 Location: ,Newcastle Upon Tyne , United Kingdom. Posts: 957 Blog Entries: 6 Thanks: 450 Thanked 151 Times in 80 Posts Social Networking Contact Info	Re: Hiding the Good Stuff so Visitors HAVE to Subscribe! Thanks everyone for the help. Its been very sueful, far more useful than my hosting's 24/7 support, who told me I'd need to contact Google if I didn't want my page indexed.
	"Better a student of reality than a master of illusion" Live Case Study: How to Setup a Business in your Spare-Time, Generate Quality Traffic, Make Money Online and Escape the Rat Race

08-31-2008, 09:02 AM	#8
Roy Carter InfoProductsMadeEasy.com War Room Member Join Date: May 2007 Location: , , Cyprus. Posts: 1,126 Thanks: 16 Thanked 103 Times in 53 Posts	Re: Hiding the Good Stuff so Visitors HAVE to Subscribe! Alex - Check out DLGuard for the best way of protecting your stuff from prying eyes. Roy
	================================================== ======= "Amazing FREE WSO! - Exactly How I Get Some of The Top Name Marketers In the World To Promote My Products! (Even When They've Never Heard of Me)! - Get This FREE! >> ---> http://tinyurl.com/JVmagic <--- < <

08-31-2008, 11:42 AM	#9
David-JP HyperActive Warrior War Room Member Join Date: Jul 2007 Location: Singapore Posts: 472 Thanks: 8 Thanked 27 Times in 23 Posts	Re: Hiding the Good Stuff so Visitors HAVE to Subscribe! There's 2 ways you can look at protected content. Walled Garden - all content is protected, usually in its own directory. Magazine Model - teaser text is shown, but the rest of the content is protected. I've used amember to do both of these models, with wordpress or joomla handling the content on them. You can see my sig for a demo of a magazine model site. David
	The Nuts and Bolts of Starting-Up and Running a Successful Membership Site ==Membership Academy== aMember/Wishlist Hacks and How To Videos Wishlist Member Fixed Term Membership Site Demo and Sales Page Wordpress / aMember Demo site-Wordpress aMember Kick-Butt Revolution themed Wordpress-aMember turnkey service: Check it out! Last edited by David-JP; 09-01-2008 at 12:18 PM.