7 {{ upvoteCount | shortNum }}
7 {{ upvoteCount | shortNum }}

Indexation problems for a Wordpress blog

by Frederik Trovatten
6 replies
  • SEO
    • |
Hey guys,

I have an very annoying issue.
My Wordpress-blog over at Trovatten.com has some indexation-problem..

Google Webmaster Tools data:
GWT says the following: "Sitemap contains urls which are blocked by robots.txt." and shows me my homepage and my blogposts..

This is my Robots.txt:
"User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/

Sitemap: "


Do you have any idea why it says that the URL's are being blocked by robots.txt when that looks how it should? I've read a couple of places that it can be because of a Wordpress Plugin that is creating a virtuel robots.txt, but I can't validate it..

What do you think?
#blog #indexation #problems #wordpress
  • Profile picture of the author mosthost
    Try removing the robots.txt file altogether and revalidate it in GWT.
    {{ DiscussionBoard.errors[6092229].message }}
    • Profile picture of the author Frederik Trovatten
      I just removed my robots.txt and run a Sitemap-test again.. Same results.. :/.."Sitemap contains urls which are blocked by robots.txt."
      {{ DiscussionBoard.errors[6092234].message }}
  • Profile picture of the author mosthost
    Disable all the plugins and try again. That will tell if it's a plugin or not.
    {{ DiscussionBoard.errors[6092247].message }}
    • Profile picture of the author Frederik Trovatten
      I just deactivated and I get the same results.. wtf..This is really strange..
      {{ DiscussionBoard.errors[6092294].message }}
    • Profile picture of the author Frederik Trovatten
      And just for the record; The "Privacy"-setting in WP is set to: "Allow search engines to index this site."..
      {{ DiscussionBoard.errors[6092308].message }}
  • Profile picture of the author ITGeek
    Did you manage to resolve this? I'm stuck with the same issue!
    {{ DiscussionBoard.errors[6358349].message }}

Trending Topics