Anyone tell me what this code does?

7 replies
  • SEO
  • |
Hi

What exactly does this code do?
Thx

<meta name="robots" content="follow, all" />
#code
  • You include this line in your HTML code when you want all of the robots or spiders to follow all content and links on your website. This helps new sites to get indexed quickly on all search engines.
    {{ DiscussionBoard.errors[1929702].message }}
  • Profile picture of the author Goatboy
    It talks to the spiders and asks them to look at and index all of your pages.
    {{ DiscussionBoard.errors[1929792].message }}
  • Profile picture of the author sloanjim
    ok thanks for that..so without it...what happens?
    Signature

    15 Minute Forex Bar Trading System Free at
    http://www.fxscalpingmethod.com

    {{ DiscussionBoard.errors[1929799].message }}
  • Profile picture of the author Goatboy
    It looks to me like part of your robots.txt file. Without it, some spiders may not index your pages, or the indexing may be slower, or it may not make much of a difference at all.

    To the best of my knowledge, it doesn't hurt anything at all the way it is. The robots.txt is usually used to keep spiders away from certain pages, files, or parts of the website. Well mannered spiders will obey it. Unruly ones will do what they want.
    {{ DiscussionBoard.errors[1929839].message }}
    • Profile picture of the author Peter Gregory
      Originally Posted by Goatboy View Post

      It looks to me like part of your robots.txt file. Without it, some spiders may not index your pages, or the indexing may be slower, or it may not make much of a difference at all.

      To the best of my knowledge, it doesn't hurt anything at all the way it is. The robots.txt is usually used to keep spiders away from certain pages, files, or parts of the website. Well mannered spiders will obey it. Unruly ones will do what they want.
      Just to clarify it is not a part of the robots.txt file it goes in your meta info on pages you want spiders to follow the links on. Just a heads up
      {{ DiscussionBoard.errors[1930576].message }}
  • Profile picture of the author randalblanchette
    Yep, spider talker. Follow all links commands. It is kinda off though, something does not look right. I'll have to take a look elsewhere and get back to you for sure.
    {{ DiscussionBoard.errors[1930488].message }}
  • Profile picture of the author CliveG
    Personally, I think that you are better off using a robots.txt file as more robots seem to comply with the file than the meta tag and you do not need to remember to include the tag on every page of your websites.
    {{ DiscussionBoard.errors[1934011].message }}

Trending Topics