Stopping SE Spiders indexing 'certain' pages? How?

by entry
3 replies
Is using this piece of code alone

<META name="robots" CONTENT="noindex, nofollow">

on some Basic pages enough, to stop the Search engines indexing them?

(I have given them long random extensions, so people wont guess them)


I want these Pages NOT to be showed when somebody enteres this in google

Site:Mysite.com

so would that green above code be enoug, to use on every one of them pages?
#indexing #pages #spiders #stopping
  • Profile picture of the author Bewley
    Originally Posted by entry View Post


    I want these Pages NOT to be showed when somebody enteres this in google


    Site:Mysite.com

    so would that green above code be enoug, to use on every one of them pages?
    Checkout The Web Robots Pages It will tell you all you need to know about blocking certain content from the SEs
    {{ DiscussionBoard.errors[2556890].message }}
  • Profile picture of the author petevamp
    Originally Posted by entry View Post

    Is using this piece of code alone

    <META name="robots" CONTENT="noindex, nofollow">

    on some Basic pages enough, to stop the Search engines indexing them?

    (I have given them long random extensions, so people wont guess them)


    I want these Pages NOT to be showed when somebody enteres this in google

    Site:Mysite.com

    so would that green above code be enoug, to use on every one of them pages?

    Using the noindex tag should work but your can also tell the robots to leave a crtain directory alone and not index any thing at all in that directory. I had to do this when I installed tubepress on my blog because it was makeing the search engines rank me lower and give others access to my site file so they could have reset the videos or disabled my data base for a few of the files so I added the disallow tag to the robots text and it solved the problem.
    {{ DiscussionBoard.errors[2556925].message }}
    • Profile picture of the author entry
      Originally Posted by petevamp View Post

      Using the noindex tag should work but your can also tell the robots to leave a crtain directory alone and not index any thing at all in that directory. I had to do this when I installed tubepress on my blog because it was makeing the search engines rank me lower and give others access to my site file so they could have reset the videos or disabled my data base for a few of the files so I added the disallow tag to the robots text and it solved the problem.
      It made you rank lower? But i thought you didn't want to rank atal? as you were using the Nofollow - no index method?

      Oh so its best to make the robots NOT access the whole of the directory, as it can negavive rank your site?

      Signature
      I Have to say a Massive...THANK YOU to every Warrior who has helped me, and thanks to every warrior who helps me in the future...
      {{ DiscussionBoard.errors[2562035].message }}

Trending Topics