| | ||||||||
| |||||||||
 |
03-09-2011, 07:42 PM
| #1 |
| Active Warrior Join Date: Dec 2010
Posts: 42
Thanks: 0
Thanked 0 Times in 0 Posts
|  How to generate robot.txt file on any website !
How to generate robot.txt file and suppose that you want block admin of any website then how to generate it. please suggest me guys with such example. |
|  |
|
03-09-2011, 07:46 PM
| #2 |
| Senior Warrior Member  Join Date: Nov 2005 Location: Tampa, Florida
Posts: 4,643
Thanks: 162
Thanked 671 Times in 581 Posts
| Re: How to generate robot.txt file on any website !
Hi zsawevv212, Everything you want to know about robots.txt: The Web Robots Pages Block or remove pages using a robots.txt file - Webmaster Tools Help |
|
Don Burk * Get Results - Outsource Your PPC Management * Get a Keyword Domain Name - www.SeriousNames.com | |
|
| |
|
03-09-2011, 07:54 PM
| #3 |
| pay them no mind War Room Member  Join Date: Jul 2009 Location: StL
Posts: 1,133
Thanks: 207
Thanked 353 Times in 229 Posts
| Re: How to generate robot.txt file on any website ! You could always open up Notepad/Textpad/Wordpad/Whatever and type in: HTML Code: Sitemap: http://www.mysite.com/sitemap.xml User-agent: * Disallow: /cgi-bin/ Then "Save As" robots.txt Yeah... That easy. |
| scott g "Whatever the mind can conceive and believe, the mind can achieve." zoloft birth defects & zoloft lawsuit paxil birth defects & paxil lawsuit avandia lawsuit celexa birth defects & celexa lawsuit lexapro birth defects & lexapro lawsuit lawsuitinformation.org | |
|
| |
 |
|
| Tags |
| file, generate, robottxt, website |
| Thread Tools | |
| |
 |
