Robots.txt file?
I have a site (I own the domain and have it on my own hosting) where on the front end I have uploaded a branded store from an affiliate network in the Health niche. I have also attached a blog to the backend of the site.
My question is how do I format the Robots.txt file to index the content on the backend blog and not the main domain.
The txt file that came with the branded store was as follows which disallows all bots from accessing any area of the store:
User-agent: *
Disallow: /
If I wanted the content on the backend blog indexed, would I format the file like this:
User-agent: *
Allow: /blog/
Disallow: /
Thank you for your help in this matter.
Bored. Learn everything you need to know about Organic Gardening.