8 {{ upvoteCount | shortNum }}
8 {{ upvoteCount | shortNum }}

robots.txt

by webber1
6 replies
  • SEO
    • |
Hi there I recently done a quick analysis of my website and it said i did not have a robots.txt file or an author tag. Can someone tell me what these are and how I go about getting them?
thanks
#robotstxt
  • Profile picture of the author Viper X
    What is it that you are trying to do?
    Signature

    {{ DiscussionBoard.errors[1675411].message }}
  • Profile picture of the author webber1
    well for the next month until March I am trying to get my site from page 2 on google to page 1. This analysis tool said i was missing these and I needed them?
    {{ DiscussionBoard.errors[1675461].message }}
  • Profile picture of the author Marko Vel
    Here you can find some interesting tips
    hxxp://www.free-seo-news.com/all-about-robots-txt.htm
    Signature
    Serpline - Powerful SEO guidelines
    {{ DiscussionBoard.errors[1675512].message }}
  • Profile picture of the author Zeus66
    The robots.txt file is super easy. If you don't have any files on your server you want to hide form search engine robots, just create a blank .txt file in Notepad and save it as robots.txt. Then upload that to your root directory, which is the public_html directory for most web hosts. Same place you put your index.html page, etc. Then the search engines will see the robots.txt file, scan it, see that it's not disallowing them anywhere, and scour your whole site (eventually).

    John
    {{ DiscussionBoard.errors[1675914].message }}
    • Profile picture of the author John Hocking
      Here is a link to a robots.txt generator

      Robots.txt Generator - McAnerin International Inc.

      Just fill out the form and it will create a text file you can upload to your server.
      Signature
      {{ DiscussionBoard.errors[1676177].message }}
    • Profile picture of the author BethanyTbloosky
      Originally Posted by Zeus66 View Post

      The robots.txt file is super easy. If you don't have any files on your server you want to hide form search engine robots, just create a blank .txt file in Notepad and save it as robots.txt. Then upload that to your root directory, which is the public_html directory for most web hosts. Same place you put your index.html page, etc. Then the search engines will see the robots.txt file, scan it, see that it's not disallowing them anywhere, and scour your whole site (eventually).

      John
      John this is the perfect answer to this, thank you, I'm sure others will find it useful too!

      If you are hiding certain pages from the Search Engine, what do you susggest?

      Thanks!
      Signature
      Bethany Taylor :: vintage-mod.com
      Affiliate Manager- Bloosky.com
      AIM & Skype: bethanytbloosky
      btaylor@bloosky.com
      {{ DiscussionBoard.errors[1676363].message }}

Trending Topics