robots.txt help needed

by mraffiliate 0 replies
After installing the Wordpress SEO byYoast plugin, I started noticing "Restricted by robots.txt" in my Webmaster Tools. Here is the list so far:

http://mysite.com/wp-includes/js/swfobject.js?ver=2.2
http://mysite.com/wp-includes/js/jquery/
http://mysite.com/wp-includes/pomo/entry.php
http://mysite.com/wp-includes/js/thickbox/
http://mysite.com/wp-includes/pomo/po.php
http://mysite.com/wp-includes/js/scriptaculous/

I noticed that some of the checkboxes under the "Indexation Rules" were checked, so I unchecked them and saved the settings. These robot.txt messages still keep appearing so it appears that the plugin hasn't reversed what it wrote to the robots.txt file previously.

I typed in my domain" http://mysite.com/robots.tx and I get this:

----------------------------------------------------------------------
User-agent: *
Disallow: /wp-admin/

Disallow: /wp-includes/

Sitemap: http://mysite.com/sitemapindex.xml
---------------------------------------------------------------

I'm not sure what was on my robots.tx file before I unchecked
indexation rules in the plugin, but is what is in my robots.txt
above fine or should the /wp-includes/ be removed?
#website design #needed #robotstxt
Avatar of Unregistered

Trending Topics

  • 90 {{ upvoteCount | shortNum }}

    Warriors .... Warriors.... what would you like to LEARN?

    Good Morning awesome Warriors... I'm happy to announce that The Warrior Forum is planning to create our first COURSE. Yes... Powered by Warrior Wisdom... yeah!! Made at home. But before ... [read more]

  • 17 {{ upvoteCount | shortNum }}

    1 Powerful Concept that Grows Your Business

    Connect with people interested in what you have to offer. Mindfully. Versus desperately running from prospect to prospect, or from number to number. This idea sounds simple, and like common ... [read more]

  • 44 {{ upvoteCount | shortNum }}

    How I Sold 985 Copies of an Affiliate Offer in 5 Days (Step by Step)

    When I first started online in 2002, it took me a year to sell 985 copies of anything. These days, I can typically do it in the span of a ... [read more]

  • 4 {{ upvoteCount | shortNum }}

    What basic life skill are you constantly amazed people lack?

    sunnykhan345 in Off Topic

    What basic life skill are you constantly amazed people lack?

  • 1 {{ upvoteCount | shortNum }}

    Need help on TopClassifiedsoftware script.

    Lew3 in Programming

    I have installed the TopClassifiedsoftware on my website and everything works except I get the following showing up on the webpages: Deprecated: mysql_escape_string(): This function is deprecated; use mysql_real_escape_string() instead. ... [read more]