5 {{ upvoteCount | shortNum }}
5 {{ upvoteCount | shortNum }}

Quick Question

by clbeav
4 replies
  • WEB DESIGN
    • |
I've seen it before but it's slipped my mind. What are the meta tags or code you put in to tell a search engine to exclude that site from its indexing. Thanks in advance.
#question #quick
  • Profile picture of the author CaffeinatedWorld
    There are two solutions to do this.

    One is to put in a meta-tag like this:
    <meta name="robots" content="noindex,nofollow">

    The other is to create robots.txt and put it your main directory.
    Inside the robots.txt you put this:

    User-agent: WebCrawler
    Disallow: /
    {{ DiscussionBoard.errors[974279].message }}
    • Profile picture of the author clbeav
      Originally Posted by CaffeinatedWorld View Post

      There are two solutions to do this.

      One is to put in a meta-tag like this:
      <meta name="robots" content="noindex,nofollow">

      The other is to create robots.txt and put it your main directory.
      Inside the robots.txt you put this:

      User-agent: WebCrawler
      Disallow: /
      Thanks this is what I was looking for.
      {{ DiscussionBoard.errors[974762].message }}
  • Profile picture of the author staffelseo
    it is a robot.txt, also have all thing settle up on links to be index or not
    Signature
    EPIC ONE TIME FEE SEO SERVICE + FREE CONSULTATION!

    NO RANK = REFUND
    100% RANK INDUCING MONSTER RANKING SERVICE
    {{ DiscussionBoard.errors[1017751].message }}

Trending Topics