robots.txt help needed

by mraffiliate 0 replies
After installing the Wordpress SEO byYoast plugin, I started noticing "Restricted by robots.txt" in my Webmaster Tools. Here is the list so far:

http://mysite.com/wp-includes/js/swfobject.js?ver=2.2
http://mysite.com/wp-includes/js/jquery/
http://mysite.com/wp-includes/pomo/entry.php
http://mysite.com/wp-includes/js/thickbox/
http://mysite.com/wp-includes/pomo/po.php
http://mysite.com/wp-includes/js/scriptaculous/

I noticed that some of the checkboxes under the "Indexation Rules" were checked, so I unchecked them and saved the settings. These robot.txt messages still keep appearing so it appears that the plugin hasn't reversed what it wrote to the robots.txt file previously.

I typed in my domain" http://mysite.com/robots.tx and I get this:

----------------------------------------------------------------------
User-agent: *
Disallow: /wp-admin/

Disallow: /wp-includes/

Sitemap: http://mysite.com/sitemapindex.xml
---------------------------------------------------------------

I'm not sure what was on my robots.tx file before I unchecked
indexation rules in the plugin, but is what is in my robots.txt
above fine or should the /wp-includes/ be removed?
#website design #needed #robotstxt
Avatar of Unregistered

Trending Topics

  • 1 {{ upvoteCount | shortNum }}

    Toys R US filed for Bankruptcy. It lost to E-Commerce. Good News or Bad News for you.

    Amit Patel in eCommerce

    How many of you in the Warrior Forum House are on E-Commerce? Well you have a good news. E-Commerce is the fastest growing business in the world today. And this ... [read more]

  • 1 {{ upvoteCount | shortNum }}

    Are you the Warrior of the Month?

    rankinghero in Internet Marketing

    so.....we are launching the Warrior of the Month mini competition... Yes... every Month we will announce who was the Warrior with the most valuable post. This is our own small ... [read more]

  • 2 {{ upvoteCount | shortNum }}

    Giveaways / Freebies: what are yours?

    Connann in Internet Marketing

    We all use giveaways and freebies for building our list in email marketing Today's it seems the uptrend is videos, with the 6 video formula, etc Even if the vast ... [read more]

  • 2 {{ upvoteCount | shortNum }}

    is this against CL rules?

    dj2590 in Internet Marketing

    is it against craigslist rules to post my website/ landing page in the offers categories? My front end offer is an affiliate marketing course and the rest of the follow ... [read more]

  • 121 {{ upvoteCount | shortNum }}

    Warriors .... Warriors.... what would you like to LEARN?

    Good Morning awesome Warriors... I'm happy to announce that The Warrior Forum is planning to create our first COURSE. Yes... Powered by Warrior Wisdom... yeah!! Made at home. But before ... [read more]