Anyone tell me what this code does?

by 7 replies
8
Hi

What exactly does this code do?
Thx

<meta name="robots" content="follow, all" />
#search engine optimization #code
  • You include this line in your HTML code when you want all of the robots or spiders to follow all content and links on your website. This helps new sites to get indexed quickly on all search engines.
  • It talks to the spiders and asks them to look at and index all of your pages.
  • ok thanks for that..so without it...what happens?
  • It looks to me like part of your robots.txt file. Without it, some spiders may not index your pages, or the indexing may be slower, or it may not make much of a difference at all.

    To the best of my knowledge, it doesn't hurt anything at all the way it is. The robots.txt is usually used to keep spiders away from certain pages, files, or parts of the website. Well mannered spiders will obey it. Unruly ones will do what they want.
    • [1] reply
    • Just to clarify it is not a part of the robots.txt file it goes in your meta info on pages you want spiders to follow the links on. Just a heads up
      • [ 1 ] Thanks
  • Yep, spider talker. Follow all links commands. It is kinda off though, something does not look right. I'll have to take a look elsewhere and get back to you for sure.
  • Personally, I think that you are better off using a robots.txt file as more robots seem to comply with the file than the meta tag and you do not need to remember to include the tag on every page of your websites.

Next Topics on Trending Feed