8 {{ upvoteCount | shortNum }}
8 {{ upvoteCount | shortNum }}

How to not crawl or index a page in Google.?

by paulrigby
7 replies
  • SEO
    • |
Hi,

I don't want to index or crawl a particular page of my website in Google search engine.

What i have to do for that. Please suggest me some URL or code so that it may help me..

Thanks
#crawl #google #index #page
  • Profile picture of the author swords
    Everything you need to know (read it carefully):

    Block or remove pages using a robots.txt file - Webmaster Tools Help
    Signature
    {{ DiscussionBoard.errors[5004863].message }}
    • Profile picture of the author paulgl
      The only sure 100% way is to put them behind a password.

      If you've already put them on the web, you may be
      too late. Remember, google is not the only thing
      that crawls and indexes stuff. Google may find it, one
      way or the other, off these secondary and even
      tertiary sites.

      If it's on the web, it can be found. Don't put anything on
      your site that you really don't want google or anyone else
      to see without password protecting the page. Very easy,
      just create a subfolder and password protect that. Then
      anything in that folder is not ever seen by anyone.

      Paul
      Signature

      If you were disappointed in your results today, lower your standards tomorrow.

      {{ DiscussionBoard.errors[5004896].message }}
    • Profile picture of the author paulrigby
      Originally Posted by swords View Post

      Everything you need to know (read it carefully):

      Block or remove pages using a robots.txt file - Webmaster Tools Help
      Thanks swords.

      I just want Google to not indexing a particular page. Can you suggest me the code.?
      {{ DiscussionBoard.errors[5004959].message }}
      • Profile picture of the author Jack Samurai
        Originally Posted by paulrigby View Post

        Thanks swords.

        I just want Google to not indexing a particular page. Can you suggest me the code.?
        You can edit like this in robot.txt

        User-Agent: Googlebot
        Disallow: /youtperticularpagename/
        {{ DiscussionBoard.errors[5004967].message }}
  • Profile picture of the author Jack Samurai
    robot.txt helps to not crawl a particular page.

    For example:

    User-agent: *
    Disallow: /yourperticularpagename/
    {{ DiscussionBoard.errors[5004958].message }}
  • Profile picture of the author jushuaburnham
    Build more quality links as well ping your page in regular basis
    Signature
    Barcode Reader Software | Pacman Game Download | How to Solve Sudoku
    {{ DiscussionBoard.errors[5005013].message }}
  • Profile picture of the author forest l
    [DELETED]
    {{ DiscussionBoard.errors[5005902].message }}
  • Profile picture of the author murrad
    Originally Posted by paulrigby View Post

    Hi,

    I don't want to index or crawl a particular page of my website in Google search engine.

    What i have to do for that. Please suggest me some URL or code so that it may help me..

    Thanks
    If you want to avoid your secret/important folder to hide from any search engine.. use this code.
    HTML Code:
    User-agent: *
Disallow: /<your-folder-to-hide-from-searchengines>
    Signature

    Are you looking for Work from Home Jobs?

    {{ DiscussionBoard.errors[5006202].message }}

Trending Topics