0 {{ upvoteCount | shortNum }}
0 {{ upvoteCount | shortNum }}

robots.txt help needed

by mraffiliate
0 replies
  • WEB DESIGN
    • |
After installing the Wordpress SEO byYoast plugin, I started noticing "Restricted by robots.txt" in my Webmaster Tools. Here is the list so far:

http://mysite.com/wp-includes/js/swfobject.js?ver=2.2
http://mysite.com/wp-includes/js/jquery/
http://mysite.com/wp-includes/pomo/entry.php
http://mysite.com/wp-includes/js/thickbox/
http://mysite.com/wp-includes/pomo/po.php
http://mysite.com/wp-includes/js/scriptaculous/

I noticed that some of the checkboxes under the "Indexation Rules" were checked, so I unchecked them and saved the settings. These robot.txt messages still keep appearing so it appears that the plugin hasn't reversed what it wrote to the robots.txt file previously.

I typed in my domain" http://mysite.com/robots.tx and I get this:

----------------------------------------------------------------------
User-agent: *
Disallow: /wp-admin/

Disallow: /wp-includes/

Sitemap: http://mysite.com/sitemapindex.xml
---------------------------------------------------------------

I'm not sure what was on my robots.tx file before I unchecked
indexation rules in the plugin, but is what is in my robots.txt
above fine or should the /wp-includes/ be removed?
#needed #robotstxt

Trending Topics