Addon domains and crawlers

by rhodie
2 replies
I have a few sites hosted with Just Host and I was wondering how search engine indexing bots treat the sub domains. I have used robots.txt on the main site to exclude the directories that exist to house the addon domains.

Will this work? Is it necessary?
#addon #crawlers #domains #just host #robots.txt
  • Profile picture of the author salegurus
    i have many add-ons in my account and they get indexed just as fast as main domains, so to answer there does not seem to be any diffs.
    Signature
    Think of how stupid the average person is, and realize half of them are stupider than that.

    ― George Carlin
    {{ DiscussionBoard.errors[1837981].message }}
  • Profile picture of the author rhodie
    Thanks for the feedback guys.
    {{ DiscussionBoard.errors[1838479].message }}

Trending Topics