4 {{ upvoteCount | shortNum }}
4 {{ upvoteCount | shortNum }}

Robots.txt file on aliased domain

by conceptmarketing
3 replies
  • WEB DESIGN
    • |
Hey I have a question for you and please bear with me as I focus more on SEO work than actual design/development which for the most part I outsource.

I have a deluxe hosting plan on godaddy. I have a primary domain installed directly to the root and several other domains that are aliased.

Now I installed my primary site using Joomla 1.5 should I be excluding the images, install and includes directories etc? Is this robots file configured correctly to keep these directories form being indexed?

User-agent: *
Disallow:
Disallow: /cgi-bin/
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
#aliased #domain #file #robotstxt
  • Profile picture of the author Abhishek Kundu
    hi conceptmarketing,

    the robot.txt file is ok but it's better you don't keep unwanted lines in it.

    Code:
    User-agent: *
Disallow: /cgi-bin/
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
    hope this helps you to keep the search engines robots away from the above mentioned directories.
    Signature
    CLICK HERE>>> FOLLOW ME ON TWITTER <<
    {{ DiscussionBoard.errors[4313545].message }}

Trending Topics