What is the difference between .htaccess and robots.txt?

3 replies
  • SEO
  • |
Please someone let me know the difference between these two:

.htaccess and robots.txt
#difference #htaccess #robotstxt
  • Profile picture of the author aaron_nimocks
    Robot.txt is primarily used to restrict/approve access for spiders

    .htaccess is primarily used for mod_rewrite, blocking IPs, and file/directory access
    Signature

    My free PSD logs can be downloaded at PSD Bum. Enjoy!

    {{ DiscussionBoard.errors[3161298].message }}
    • Profile picture of the author punksluck
      .htaccess is primarily used for configuring permissions on your server, you would use this file to allow friendly URL's to be written. This is crucial if you want your site to rank well.

      configuring the robots.txt file is useful so that you can tell any bot that spiders your site where they can go and where they are not allowed. This can save you a huge amount of bandwidth as you only really want search engine spiders to crawl the parts of your site that can actually be indexed and just ignore the rest.
      {{ DiscussionBoard.errors[3161798].message }}
  • Profile picture of the author ramashankar
    Hello friends
    I think .htaccess is used in guiding the behaviors of your own sites while robots.txt file is used in guiding the behaviors of search engine bots.
    {{ DiscussionBoard.errors[3167486].message }}

Trending Topics