Is My Robots File Affecting Anything?

5 replies
  • SEO
  • |
Is my robots file affecting anything?

I have over 2000 pages indexed by google but only 1 backlink?

propeptides .net/robots.txt

??
#affecting #file #robots
  • Profile picture of the author retsek
    robots.txt doesn't have anything to do with your backlinks.
    Add you site to Google and Bing's Webmaster tools. They'll alert you to any issues and pages which are blocked.
    {{ DiscussionBoard.errors[6543504].message }}
  • Profile picture of the author Blue445nm
    Originally Posted by Maverick86 View Post

    Is my robots file affecting anything?

    I have over 2000 pages indexed by google but only 1 backlink?

    propeptides .net/robots.txt

    ??
    Did you get my last post? You have over 2,000+ backlinks.
    Signature

    {{ DiscussionBoard.errors[6543674].message }}
  • Profile picture of the author Maverick86
    Is there anything at all wrong with allowing it to access ALL directories? i.e. unrestricting the robots.txt file all together?
    {{ DiscussionBoard.errors[6544502].message }}
    • Profile picture of the author retsek
      Originally Posted by Maverick86 View Post

      Is there anything at all wrong with allowing it to access ALL directories? i.e. unrestricting the robots.txt file all together?
      You want to present your best face to the search engines. Allowing them to index everything including duplicates or pages such as your 'print version' or 'search results' will not do you any good.

      A common trait in some sites that were hit by Panda were loads of indexed duplicate and thin content.
      {{ DiscussionBoard.errors[6544541].message }}
  • Profile picture of the author gPlayer
    Is there anything at all wrong with allowing it to access ALL directories? i.e. unrestricting the robots.txt file all together?
    There is no problem for the search engine but there is problems for you. You can't allow search engine to index all the pages. If you allow then spammers can use them to get information that you don't want to share with someone.
    {{ DiscussionBoard.errors[6544988].message }}

Trending Topics