8 replies
  • SEO
  • |
Do Subdirectories with gTLD Need separate Robots.txt?

wwwdotexampledotcom is the global version

The global version is included with all robots.txt.

I wanted to know do we need to add a specific robots.txt for separate country targeted Domains
eg: wwwdotexampledotcom/uk

wwwdotexampledotcom/uk/robots.txt

Please Help!
#robotstxt #seo
Avatar of Unregistered
  • Profile picture of the author dave_hermansen
    Your examples are not separate domains or subdomains. They are directories (folders) within your main domain that already has a robots.txt file. So no, those examples would not need a separate robots.txt file.
    Signature
    StoreCoach.com- Learn How to Dropship the Right Way - Buy & Sell Websites - Partner with Coach
    My PROVEN ecommerce process, as seen on: Fox News, the NY Times & Flippa
    {{ DiscussionBoard.errors[11585866].message }}
  • Profile picture of the author cmsminds
    Absolutely not. You are not using any subdomain or other primary domain but subdirectories/folder. So, you don't need to set a different robots.txt file. A separate robots.txt file is needed when you have a new primary domain or a subdomain of your primary domain. Otherwise, you can manage directories/folders (which you have mentioned) directly through the main domains robots.txt.
    {{ DiscussionBoard.errors[11586054].message }}
  • Profile picture of the author jeetengupta@jsg
    No.....You don't need to set a different robots.txt file.
    {{ DiscussionBoard.errors[11586308].message }}
  • Profile picture of the author evertdaygadget
    Hello dear, this is not right option you should to use google recommended method robot.txt which is updated some week ago google was called that all the old method robot.txt is not working because google is updated there algorithm. you should to do follow new technique or rules then you will able solve this problem.thank you
    {{ DiscussionBoard.errors[11586392].message }}
  • {{ DiscussionBoard.errors[11586517].message }}
  • Profile picture of the author jjshouse
    You don't need separate robot.txt for your folder

    You can use same robot.txt just add a salsh and folder name

    allow or disallow : yourdomaincom/folder/img

    And search engines will follow your instructions.
    {{ DiscussionBoard.errors[11586755].message }}
  • Profile picture of the author Hih7Webtech
    As most of the members already said that Robot.txt is created under Root so no need to think about branches I mean sub-directories. One is enough to all. Just write it properly.
    {{ DiscussionBoard.errors[11586802].message }}
  • Profile picture of the author sneha Sethi
    No. You are not using any subdomain or other primary domain but subdirectories/folder. So, you don't need to set a different robots.txt file.

    {{ DiscussionBoard.errors[11589246].message }}
Avatar of Unregistered

Trending Topics