12 {{ upvoteCount | shortNum }}
12 {{ upvoteCount | shortNum }}

Web Page Indexing Question...

by Steve Wells
10 replies
  • WEB DESIGN
    • |
I would like to know HOW to make a page of my website NOT get indexed by google or any search engine, how do I so this...........
#indexing #page #question #web
  • Profile picture of the author Orlando Web Design
    Just add this meta tag to the META tag code in the web pages you don't want indexed:

    <meta name="robots" content="noindex, follow">

    Or you can use an online robots.txt generator and upload the .txt file to your websites root directory.

    Yellowpipe - robots.txt generator, create your own robots.txt
    Signature
    Financial Thing: Peer to Peer Lending Reviews
    Poker Tilt : The Dutch Boyd Story
    {{ DiscussionBoard.errors[1862734].message }}
    • Profile picture of the author Bruce Hearder
      Yes you can use the robots.txt method, but a larg number of serach engines just ignore it and index everything anyway...

      A more reliable way to stop the search engines from indexing and entire page, would be to put a password on it, or you could simple entry the code using any of the HTML encypters out there..

      Hope this helps

      Bruce
      {{ DiscussionBoard.errors[1862862].message }}
      • Profile picture of the author Steve Wells
        Originally Posted by Bruce Hearder View Post

        Yes you can use the robots.txt method, but a larg number of serach engines just ignore it and index everything anyway...

        A more reliable way to stop the search engines from indexing and entire page, would be to put a password on it, or you could simple entry the code using any of the HTML encypters out there..

        Hope this helps

        Bruce
        So are you sayin I can scranble the code and then they cant index it? If so where is a site that I can do that on for free?
        Signature
        Need Custom Graphics Work? - Message Me For A Design Quote!
        {{ DiscussionBoard.errors[1862889].message }}
      • Profile picture of the author AnotherTime
        Originally Posted by Bruce Hearder View Post

        , or you could simple entry the code using any of the HTML encypters out there..

        Hope this helps

        Bruce
        Interesting idea Bruce... OP, are you wanting some 'viewers' to see this? What are your reasons for the crawlers not to index it. Good question as I think I may need something like this as well so looking for concepts and ideas
        {{ DiscussionBoard.errors[1864893].message }}
      • Profile picture of the author M.A.D
        Originally Posted by Bruce Hearder View Post

        Yes you can use the robots.txt method, but a larg number of serach engines just ignore it and index everything anyway...

        A more reliable way to stop the search engines from indexing and entire page, would be to put a password on it, or you could simple entry the code using any of the HTML encypters out there..

        Hope this helps

        Bruce
        Those tricks are long gone.
        Google can decrypt html, javascript, even flash.
        And can do so, for a long time.
        It can even solve math question you post on your site.


        Maybe you can save your page outside of the root folder so the search engines can't spider it.
        Then create a simple html page with a include statement to the original file.
        {{ DiscussionBoard.errors[1885102].message }}
  • Profile picture of the author AnotherTime
    As for encyrpters... take a look at Dynamic Drive DHTML Scripts- Source Code Encrypter
    {{ DiscussionBoard.errors[1864913].message }}
    • Profile picture of the author Kelly Dwayne
      Very informative information for indexing stopping form the search engine and using robot.txt at any time search engine will index and it won't consider the extension file format for that....
      {{ DiscussionBoard.errors[1866007].message }}
  • Profile picture of the author Orlando Web Design
    I suppose I answered a little prematurely on this question. I mainly target Google so the robots.txt is the method I use to stop indexing. The encryption method sometimes creates problems in regards to the websites being viewed in older browsers (ie 6 etc) nad it can create issues running scripts. I personally think the meta, robots,txt & password idea is a safer solution.
    Signature
    Financial Thing: Peer to Peer Lending Reviews
    Poker Tilt : The Dutch Boyd Story
    {{ DiscussionBoard.errors[1868448].message }}
  • Profile picture of the author naffets77
    Google specifically you can use their webmaster tools to get them to delist your site and/or locations of your site (subdomains etc..). Not sure if other search engines have options like that or not..

    Without knowing what you're trying to keep being indexed, pictures can't be indexed so you could have any text you don't want indexed as a pic. Also, you can create a lot of stuff dynamically after the page loads with javascript, javascript canvas etc..
    {{ DiscussionBoard.errors[1869329].message }}
  • Profile picture of the author smilez360
    Just use meta noindex
    Signature
    www.smilez360.com <- Funny Website, Funny Video, World Mysteries

    www.thevideowars.com
    {{ DiscussionBoard.errors[1877494].message }}

Trending Topics