How to use robots to block a website?
- SEO |
Hi,
I want to block a entire website say example.com which has some sub domains like
ab.example.com
abc.example.com
xyz.example.com
I used the general code for blocking the entire website
User-agent: *
Disallow: /
but one of the sub domain say abc.example.com is still crawling by search engine.
How to stop that?
Need answer ASAP
I want to block a entire website say example.com which has some sub domains like
ab.example.com
abc.example.com
xyz.example.com
I used the general code for blocking the entire website
User-agent: *
Disallow: /
but one of the sub domain say abc.example.com is still crawling by search engine.
How to stop that?
Need answer ASAP
Professional Amazon Seller Making $20K/Month Reselling Retail Items Found Online and In-Stores
I research hundreds of retail websites to find the most profitable arbitrage opportunities to resell on Amazon and curate them into organized daily lists