3 {{ upvoteCount | shortNum }}
3 {{ upvoteCount | shortNum }}

Robot Text

by Aries26
2 replies
Hi,

I am just kind of confused on different information I read regarding robot.txt file if we still need to use it.

Due to this 'google farmer stuff" - I encountered some information suggesting that robot.txt is not needed anymore or it will just caused alarms on google bots to be suspicious towards my site.

Please advise.

Thanks.
#robot #text
  • Profile picture of the author Sparklesperson
    It all depends on why you need to use it. I use it on my WP site to hide download pages.
    Signature

    Happy Trails!
    Patricia Reszetylo
    http://FreeHorseGifts.com

    {{ DiscussionBoard.errors[3666399].message }}
  • Profile picture of the author calfred
    You also have to know that once people know your main website URL, e.g. www.website.com, they can simply type www.website.com/robots.txt and find things (folders or files) that you have tried to hide.
    Signature

    Please do not use affiliate links in signatures

    {{ DiscussionBoard.errors[3667543].message }}

Trending Topics