4 {{ upvoteCount | shortNum }}
4 {{ upvoteCount | shortNum }}

.htaccess file and robot.txt

by firescorpz
3 replies
  • SEO
    • |
Hi,

Can some one explain the importance of .htaccess file and robot.txt?
#file #htaccess #robottxt
  • Profile picture of the author gtk29
    robot.txt is for search engines. It can be used to give the location of the sitemap file to the search engine bots. Also you can tell the search engine bots what to index and what not to index.

    .htaccess is for authorization of a directory on your site, customizing HTTP 404 messages and others. This is available only if your web server is Apache based.
    Signature
    Get 10 GB Free Online Storage from Minus
    Best Hotels and Cheap Prices
    {{ DiscussionBoard.errors[2878573].message }}
    • Profile picture of the author firescorpz
      But why don't we just let search engine to index all of our page? Why is it necessary to use robot.txt?

      Originally Posted by gtk29 View Post

      robot.txt is for search engines. It can be used to give the location of the sitemap file to the search engine bots. Also you can tell the search engine bots what to index and what not to index.

      .htaccess is for authorization of a directory on your site, customizing HTTP 404 messages and others. This is available only if your web server is Apache based.
      Signature
      Bodybuilding - jewelry shop online
      {{ DiscussionBoard.errors[2879770].message }}
  • Profile picture of the author orvn
    .htaccess also allows you to
    - Rewrite dynamic or generated URL's
    yourblog.com/1234355.php to yourblog.com/seo/how-to-edit-htaccess.php
    - Denote file types and MIME types
    - Target custom error pages
    - Automatically perform actions if an error is encountered
    - Modify an array of security settings
    - Disable and enable an array of options
    Signature
    Orun Bhuiyan[@orvn] [linkedin] See what I've been doing lately by visiting my marketing agency's site. SEOcial specializes in content marketing and integrated optimization. We create conversions for businesses by gracefully connecting the realms of design, development and marketing.
    {{ DiscussionBoard.errors[2878741].message }}

Trending Topics