Go Back   WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum
Register Blogs FAQ Social Groups CalendarHelp Desk

Reply
 
LinkBack Thread Tools
Old 04-16-2011, 09:44 AM   #1
Active Warrior
War Room Member
 
BigG95's Avatar
 
Join Date: Mar 2009
Location: Tampa Bay, FL
Posts: 87
Thanks: 32
Thanked 5 Times in 5 Posts
Default How do I remove robots.txt from Wordpress Site:

I do have some issues with google bot reading my robots.txt (see thread link below) and would like to try to remove it from one of my wordpress sites.

After checking in WP forums, I could not find anything, that shows me how, since it seems to be integrated and hidden somehow in WP itself.

Help?

Robots.txt issue

BigG95 is offline   Reply With Quote
Old 04-16-2011, 09:47 AM   #2
Advanced Warrior
War Room Member
 
Brian Alaway's Avatar
 
Join Date: Jul 2008
Location: Florida, USA.
Posts: 589
Thanks: 34
Thanked 124 Times in 108 Posts
Social Networking View Member's FaceBook Profile  View Member's Twitter Profile 
Default Re: How do I remove robots.txt from Wordpress Site:

Use ftp or better sftp.
Brian Alaway is offline   Reply With Quote
Old 04-16-2011, 10:31 AM   #3
Active Warrior
War Room Member
 
BigG95's Avatar
 
Join Date: Mar 2009
Location: Tampa Bay, FL
Posts: 87
Thanks: 32
Thanked 5 Times in 5 Posts
Default Re: How do I remove robots.txt from Wordpress Site:

It's somehow embedded in wordpress and I can not find it.

BigG95 is offline   Reply With Quote
Old 04-16-2011, 11:44 AM   #4
SEO Strategist
War Room Member
 
yukon's Avatar
 
Join Date: Jun 2010
Posts: 6,532
Thanks: 355
Thanked 1,992 Times in 1,273 Posts
Default Re: How do I remove robots.txt from Wordpress Site:

Why do you want to delete your robots.txt?

Anyway...

The robots.txt should be in your root folder.

If your running Cpanel from your hosting, just search for robots.txt

FTP, it's like I said before in your root folder.

You could also just delete the contents of the robots.txt, instead of the actual file.

yukon is offline   Reply With Quote
Old 04-16-2011, 01:10 PM   #5
Warrior Member
 
Join Date: Mar 2011
Location: Cheshire
Posts: 3
Thanks: 0
Thanked 0 Times in 0 Posts
Default Re: How do I remove robots.txt from Wordpress Site:

As I understand it, Wordpress creates a "virtual" robots.txt file which is used by the search engines, there isn't a physical file in your root. However, there are various plugins that you can install which allow you to edit the robots.txt that is generated, just go to plugins>add new and search for robots.txt and you'll see a range of options.

Swarmer
swarmer is offline   Reply With Quote
Old 04-16-2011, 01:48 PM   #6
SEO Strategist
War Room Member
 
yukon's Avatar
 
Join Date: Jun 2010
Posts: 6,532
Thanks: 355
Thanked 1,992 Times in 1,273 Posts
Default Re: How do I remove robots.txt from Wordpress Site:

If you create a new robots.txt (text file) & upload to your root folder on your site, it should replace the virtual robots.txt. That's why I said keep the actual text file in your root folder.

When you search the robots.txt url in your browser, it should show the robots.txt file that is a real text file in your root folder (assumes you create the text file & place it in the root folder). You can make edits for testing to prove hxxp://domain.com/robots.txt is actually showing the real text file.

Quote:
Originally Posted by swarmer View Post
As I understand it, Wordpress creates a "virtual" robots.txt file which is used by the search engines, there isn't a physical file in your root. However, there are various plugins that you can install which allow you to edit the robots.txt that is generated, just go to plugins>add new and search for robots.txt and you'll see a range of options.

Swarmer

yukon is offline   Reply With Quote
Reply

  WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum

Tags
remove, remove robots.txt, robots.txt, robotstxt, site, wordpress

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off



All times are GMT -6. The time now is 04:44 AM.