3 {{ upvoteCount | shortNum }}
3 {{ upvoteCount | shortNum }}

<Wordpress> PC Robots.txt trouble

by loginname
2 replies
  • SEO
    • |
Hi

wordpress 3

I've got some trouble with PC Robots.txt plugin for wordpress. The problem is that when I click view the robots.txt file (link from plugin admin) then I see the robots.txt. but it contain different info

This is what I see:
User-agent: *
Disallow: /

Sitemap: http://www.mydomain/sitemap.xml.gz

This info I thought the robots.txt should also contain:
User-agent: Alexibot
Disallow: /

User-agent: Aqua_Products
Disallow: /

User-agent: asterias
Disallow: /

What am I doing wrong here
#&ltwordpress&gt #<wordpress> #robotstxt #trouble
  • Profile picture of the author cbrauer
    Sometimes plugins that change file structures don't not work right. The best thing to do is:

    Log into your cpanel or hosting panel.
    Open the file directory for that domain name.
    locate the robots.txt file. (if there is not one go to the add file button and create one)
    Right click the robots.txt file and click edit.
    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /privatedir/
    Disallow: /tutorials/blank.htm
    This is an example of course but you can use it to block whatever directories you want.
    Signature
    Jixty Is a new search engine with tons of cool features including low cost PPC. Preview full functioning websites before clicking links to ensure high quality results.

    ArticleHomestead post articles for free and share them with the world. Do follow backlinks, please only submit quality articles.
    {{ DiscussionBoard.errors[3028108].message }}
  • Profile picture of the author mad.hat
    If you want to specifically disallow those user agents then you can but unless you have a specific reason to you don't really need to block those.
    Signature
    They All Told Me Making Money Online Was Just A Scam For The Gullible... Even Though I Was Already Pulling In $1k/Day. Now You Say My Resellers Can Not Make $1k/day But...
    {{ DiscussionBoard.errors[3033969].message }}

Trending Topics