How can I make a robot.txt file?

by zonkow

Posted: 12 years ago 8 replies

I want to block my entire site from search engine bots to deindex it.
I must create a robot.txt file to do this but I have no idea about it.
How should my robobt.txt file be ?
Where should I put it?

#file #make #robottxt

dburk 12 years ago

Hi zonkow,

Here's everything you wanted to know about robots.txt, but were afraid to ask Google about:

The Web Robots Pages
- Thanks
Signature

* Get Results - Outsource Your PPC Management |
* Don Burk Advertising & Marketing - www.donburk.com
{{ DiscussionBoard.errors[6540697].message }}
smitholivia 12 years ago

Robots.txt is a text file.To block entire site open notepad write below lines and save as robots.txt,upload in a root folder.
User-Agent:*
Disallow:/
- Thanks
{{ DiscussionBoard.errors[6546283].message }}
Devid1 12 years ago

Upload the file in root folder of your cpanel.
- Thanks
{{ DiscussionBoard.errors[6557572].message }}
sham2 12 years ago

just wrote above two lines and upload in root folder.
- Thanks
{{ DiscussionBoard.errors[6557656].message }}
julianbooth123 12 years ago

You can learn about making robots.txt using the following link:

seomoz.org/learn-seo/robotstxt
- Thanks
{{ DiscussionBoard.errors[6557721].message }}
gPlayer 12 years ago
Code:

http://www.mcanerin.com/EN/search-engine/robots-txt.asp
You can generate robot file and you will get necessary information from here.
- Thanks
- 1 reply
{{ DiscussionBoard.errors[6563432].message }}
- kindle11 12 years ago
  
  Its not a difficult task to create a robots.txt file. Its so simple to create. Take a look below:
  
  User-agent:*
  Disallow:
  
  It is by default setting of a robots.txt file. You have to upload it in root directory of website.
  
  Thanks
  
  {{ DiscussionBoard.errors[6564162].message }}
trevord92 12 years ago

Once you've uploaded it, use a checker in case you've got something wrong.
- Thanks
Signature

Get Your Brain Working Properly!
Free (good quality) Self Help Resources
Using Mindfulness to Quiet Your Mind
{{ DiscussionBoard.errors[6565342].message }}

How can I make a robot.txt file?

Trending Topics

How did you turn it all around?

A healthy fascination for Hollywood...

Any thoughts on golf's latest phenom...Scottie Scheffler??

What's the Best IM-Related Skill to Learn Today That Can Help in the Future?

best high quality crypto traffic.