6 {{ upvoteCount | shortNum }}
6 {{ upvoteCount | shortNum }}

Robots meta tag

by Paul240480
5 replies
  • SEO
    • |
This is my current robots tag:

<meta name="robots" content="index,follow">

This was advised when I first built my site. I've never changed it.

Just looking through webmaster tools & it seems to advise differently.

It suggests one of these: User-agent: * Allow: /

User-agent: Googlebot Allow: /

Being a numpty, I'm not sure where to put these or which is the best for me:confused:

I guess:
<meta name="robots" content= Googlebot Allow: />
or
<meta name="robots" content= User-agent Allow: />

Erm, not very good at this am I
Any advice gratefully received
#meta #robots #tag
  • Profile picture of the author seotechman
    Personally i would follow the the Google way.
    {{ DiscussionBoard.errors[2685887].message }}
  • Profile picture of the author bhuff85
    Both ways will work, but I usually use a robots.txt file just to be on the safe side. But like I mentioned, either one works out fine. Robots.txt files are usually easier to create, rather than using meta code in every page of your website.
    Signature
    Want to speed up your writing and save time?
    This book will show you how:
    --> Write Fast: 21 Powerful Ways to Cut Your Writing Time in Half! <--
    {{ DiscussionBoard.errors[2686022].message }}
  • Profile picture of the author evanlambda
    Either way will work just the same, Googlebot is just making sure you do not explicitly say "do not index." Any way of saying "Yes you can index" would be handled just the same.
    Signature

    I developed a new (FREE) PPC/SEO tracking system, go to lambdatracker.com to and enter your email and you will be sent the download link and install instructions .... Also increase your revenue with my Geotargeting script.

    {{ DiscussionBoard.errors[2687770].message }}
    • Profile picture of the author paulgl
      You don't really need it.
      The googlebot will always try and find it first to get any special instructions.
      If you don't have it, google will (maybe) index anything it finds. Which is
      not a problem for 99.99% of us.

      Paul
      Signature

      If you were disappointed in your results today, lower your standards tomorrow.

      {{ DiscussionBoard.errors[2687818].message }}
      • Profile picture of the author Paul240480
        Thanks all. Having now read the replies & looked around web-tools & the like. It seems to me that the only use is to stop robots from crawling certain pages. Not an issue for my humble site.

        I think I'll leave it as it is _ 'if it ain't broke'

        Thanks again for the great replies
        Signature

        Paul240480
        http://www.gitessouthbrittany.com

        {{ DiscussionBoard.errors[2689190].message }}

Trending Topics