8 {{ upvoteCount | shortNum }}
8 {{ upvoteCount | shortNum }}

no robots - dont index??

by NewbiesDiary
7 replies
G'Day

I'll say before I start that I have searched WF & G for this topic, but as I don't know the right terminology - I'm not getting the right answer - so...

How do I stop the search engines indexing my download page?

I'd rather not put a password on it, I have numbers instead of "downloadpage.html" (or whatever) so it can't be guessed, but I want to make sure that it can't be found on the search engines - just my luck the page I DON'T want indexed will make it to #1 and the sales page will never appear - hahahahaa

Any ideas on the best way to do this?

Or if a password is the way to go - what's the best way to do this to ensure the buyer doesn't get confused or pissed off with the process?
#index #robots
  • Profile picture of the author jimh1626
    Try This:
    The Web Robots Pages
    Youy can do a search on Google "robots no follow tag" and find tons of info.

    Hope that helps,

    Jim
    Signature
    http://e-bookreprintrights.com
    http://instantmembershipsitecreator.com
    http://membershipmanagersupreme.com
    {{ DiscussionBoard.errors[488337].message }}
    • Profile picture of the author Jeff Henshaw
      This has always been a pain in the backside for me. No matter what I seem to do, the search engines pick up and display my pages before my sites are ready to launch. My technique now is to keep them off my servers until I am ready to launch them.

      As for your specific issue, you have already had some sound advice and good links provided on the thread.

      For a single page I would tend to use:

      <head>
      <title> Your Web Page Title </title>
      <meta name ="keywords" content= Put Nothing In Here ></meta>
      <meta name = "description" content = Put Nothing In Here ></meta>
      <META NAME="ROBOTS" CONTENTS=" noindex ,nofollow"></meta> THAT TAG LINE IS THE IMPORTANT ONE
      </head>

      Do be aware though that not all search engine spiders are able to recognise that Robots tag and will still crawl and index your page.

      Protecting your download page(s) is the best option in my opinion.

      Best Regards,
      Jeff Henshaw.
      {{ DiscussionBoard.errors[488416].message }}
  • Profile picture of the author skydivedad
    Originally Posted by NewbiesDiary View Post

    G'Day

    I'll say before I start that I have searched WF & G for this topic, but as I don't know the right terminology - I'm not getting the right answer - so...

    How do I stop the search engines indexing my download page?

    I'd rather not put a password on it, I have numbers instead of "downloadpage.html" (or whatever) so it can't be guessed, but I want to make sure that it can't be found on the search engines - just my luck the page I DON'T want indexed will make it to #1 and the sales page will never appear - hahahahaa

    Any ideas on the best way to do this?

    Or if a password is the way to go - what's the best way to do this to ensure the buyer doesn't get confused or pissed off with the process?
    Place the following code between the <head></head> tags on the page in question.
    <META name= "robots" content="noindex, nofollow, noarchive" />

    By default the search engines assume "index, follow, archive"
    All The Best
    Paul
    Signature

    Making Lemonaide... Skydivedad's Blog

    {{ DiscussionBoard.errors[488396].message }}
  • Profile picture of the author NewbiesDiary
    thanks guys - much appreciated
    {{ DiscussionBoard.errors[488430].message }}
    • Profile picture of the author Jeff Henshaw
      Sorry, I only partially answered your question. I forgot to suggest this link for page protection:

      Password protecting web pages - The HTML Writers Guild

      I'm not trying to boost my page count - honest!!

      Regards,
      Jeff.
      {{ DiscussionBoard.errors[488439].message }}
      • Profile picture of the author skydivedad
        Jeff also gave some great advice as well. For the Title of the page and I should have mentioned this earlier. Include this
        <title>Should Not Be Indexed Or Followed</title>


        Paul
        Signature

        Making Lemonaide... Skydivedad's Blog

        {{ DiscussionBoard.errors[488769].message }}
        • Profile picture of the author dolcevita
          thank to for the advice's.
          {{ DiscussionBoard.errors[489508].message }}

Trending Topics