Need Advice on Robots.txt for ASP website
- SEO |
ASP website has five pages, but when i checked through screaming frog software, it shows around 55 urls and most of the urls are like
http://www.domain.com/WebResource.axd?d=X_J8
http://www.domain.com/ScriptResource.axd?d=HMvaB_8
http://www.domain.com/Common/images/logo.gif
http://www.domain.com/App_Themes/Theme/lrs_style.css
can i use robots.txt in asp website to disallow those urls which contain only ajax codes and images like
User-agent: *
Disallow: /Common/
Disallow: /App_Themes/
Disallow: /*?
or should i allow SE bots to crawl those pages?
Also, can i use robots.txt to disallow for asp website?
please advice, feedback appreciated?
http://www.domain.com/WebResource.axd?d=X_J8
http://www.domain.com/ScriptResource.axd?d=HMvaB_8
http://www.domain.com/Common/images/logo.gif
http://www.domain.com/App_Themes/Theme/lrs_style.css
can i use robots.txt in asp website to disallow those urls which contain only ajax codes and images like
User-agent: *
Disallow: /Common/
Disallow: /App_Themes/
Disallow: /*?
or should i allow SE bots to crawl those pages?
Also, can i use robots.txt to disallow for asp website?
please advice, feedback appreciated?
* Get Results - Outsource Your PPC Management |
* Don Burk Advertising & Marketing - www.donburk.com