8 {{ upvoteCount | shortNum }}
8 {{ upvoteCount | shortNum }}

Robots.txt In SEO ?

by adamandy
8 replies
  • SEO
    • |
Do Subdirectories with gTLD Need separate Robots.txt?

wwwdotexampledotcom is the global version

The global version is included with all robots.txt.

I wanted to know do we need to add a specific robots.txt for separate country targeted Domains
eg: wwwdotexampledotcom/uk

wwwdotexampledotcom/uk/robots.txt

Please Help!
#robotstxt #seo
Avatar of Unregistered
  • Profile picture of the author dave_hermansen
    Your examples are not separate domains or subdomains. They are directories (folders) within your main domain that already has a robots.txt file. So no, those examples would not need a separate robots.txt file.
    Signature
    BizSellers.com - The #1 place to buy & sell websites!
    We help sellers get the MAXIMUM amount for their websites and all buyers know that these sites are 100% vetted.
    {{ DiscussionBoard.errors[11585866].message }}
  • Profile picture of the author cmsminds
    Absolutely not. You are not using any subdomain or other primary domain but subdirectories/folder. So, you don't need to set a different robots.txt file. A separate robots.txt file is needed when you have a new primary domain or a subdomain of your primary domain. Otherwise, you can manage directories/folders (which you have mentioned) directly through the main domains robots.txt.
    Signature
    Shopify Development Services
    {{ DiscussionBoard.errors[11586054].message }}
  • Profile picture of the author evertdaygadget
    Hello dear, this is not right option you should to use google recommended method robot.txt which is updated some week ago google was called that all the old method robot.txt is not working because google is updated there algorithm. you should to do follow new technique or rules then you will able solve this problem.thank you
    {{ DiscussionBoard.errors[11586392].message }}
  • Profile picture of the author cheese1688
    You definitely do NOT need robots.txt in SEO.
    Signature
    [Arbitrage Rocket]
    Coaching/Mentoring Students To Reach $3000/Month
    PASSIVE Income Packages! Limited Seats!
    {{ DiscussionBoard.errors[11586517].message }}
  • Profile picture of the author jjshouse
    You don't need separate robot.txt for your folder

    You can use same robot.txt just add a salsh and folder name

    allow or disallow : yourdomaincom/folder/img

    And search engines will follow your instructions.
    {{ DiscussionBoard.errors[11586755].message }}
  • Profile picture of the author Hih7Webtech
    As most of the members already said that Robot.txt is created under Root so no need to think about branches I mean sub-directories. One is enough to all. Just write it properly.
    {{ DiscussionBoard.errors[11586802].message }}
  • Profile picture of the author sneha Sethi
    No. You are not using any subdomain or other primary domain but subdirectories/folder. So, you don't need to set a different robots.txt file.

    {{ DiscussionBoard.errors[11589246].message }}
  • Profile picture of the author Sophie Leonard
    Hi,
    The answer to your question is No, you don't need a separate robots.txt. From your example, it seems that you are talking about subdirectory and not a subdomain. You don't need to set a separate robots.txt for each subdirectory.
    {{ DiscussionBoard.errors[11590034].message }}
Avatar of Unregistered

Trending Topics