9 {{ upvoteCount | shortNum }}
9 {{ upvoteCount | shortNum }}

Google Bot and Wordpress are getting me crazy!!

by adhonys
7 replies
  • SEO
    • |
I'm really thinking about relocating my blog from wordpress to blogger. Wordpress is giving me headaches. The Google Bots is indexing pages that I have blocked in robots.txt such as comment-page-1 and replytocom.
I've tried everything.
1 - Using the WordPress Seo by Yoast do not work for me.

2 - Replytocom redirector plugin either.

3 - Replytocom controller less.

4 - I used all plugin with and without disallow the unwanted urls in the robots.txt

5 - The page comments in wp is off

6 - Now I check my site in the serps and i have 160 pages indexed with comment-page-1 and 54 with replytocom.
I dont know what the hell is happening to me! Google bot ignores nor the noindex tags or the robots.txt goals.

7 - The most beautiful thing is that I decided to delete from the database all commnets, so there are no comments on my blog and yet these things are apearing.

All these indexed urls are redirected inmediately to te
he canonical version, so i dont know how could them be idnexed by google.

Also the add parameters section in the webmaster tools didn't worked for me

ANY HELP!!!!!!! could be and server issue?????
#bot #crazy #google #wordpress
  • Profile picture of the author yukon
    Banned
    All you have to do is noindex the pages you don't want indexed in Google SERPs.

    This (below) will speed up the removal of existing indexed pages, you still need to noindex the pages first to prevent Google from reindexing the pages again later on.

    If the content is currently in our index, we will remove it after the next time we crawl it. To expedite removal, use the URL removal request tool in Google Webmaster Tools.
    {{ DiscussionBoard.errors[8373422].message }}
  • Profile picture of the author TheContentAuthority
    Adhonys,

    Are you sure the robots file is being configured properly by these plugins? I would say if they aren’t working, just upload the robots file to your server yourself. Perhaps you could post a link and we could tell you if its right or not.

    Keep in mind that if pages were already indexed, adding them to the file will do nothing but stop Google from crawling them again. SERPs also take a long time to update.

    Best,

    Shawn
    Signature
    Outsource to the experts...

    We customize your Blog, eBook, Press Release and Sale Copy content with your message.

    {{ DiscussionBoard.errors[8374319].message }}
  • Profile picture of the author adhonys
    Here is my robots.txt

    User-agent: Mediapartners-Google
    Disallow:
    User-Agent: Googlebot-Image
    Allow: /wp-content/imagenes

    User-agent: *
    Disallow: /wp-
    Disallow: /search/
    Disallow: /author/
    Disallow: /page/
    Disallow: /page*/
    Disallow: /tag/
    Disallow: /feed
    Disallow: /feed/
    Disallow: /archives/
    Disallow: /trackback/
    Disallow: /trackback
    Disallow: /trackback*/
    Disallow: /attachment*/
    Disallow: /top-10/
    Disallow: /category/
    Disallow: /?feed=rss2
    Disallow: /?wptouch*
    Disallow: /comments/
    Disallow: *comment-
    Disallow: /archives/
    Disallow: /tag/
    Disallow: /plugins/
    Disallow: /top-10/
    Disallow: /comment-page-1/
    Disallow: /comment-page-2/
    Disallow: /comment-page-1
    Disallow: /comment-page-2
    Disallow: /?iframe=true&width=95%&height=95%
    Disallow: /cgi-bin/
    Disallow: /stats/
    Disallow: /logs/
    {{ DiscussionBoard.errors[8375458].message }}
  • Profile picture of the author yukon
    Banned
    Looks like your blocking a few things for no reason.
    • Disallow: /feed/
    • Disallow: /category/

    Those two pages are both doorways to your content that you want indexed, no reason to block those pages. If your blocking the category page because you have the full post preview showing on the category page there's a better way to handle duplicate pages which is by using a canonical tag.

    Again, use a noindex tag for pages you don't want indexed in Google SERPs, it works.
    {{ DiscussionBoard.errors[8375818].message }}
  • Profile picture of the author adhonys
    This in one of the urls with noindex meta tags": » Descargar gratis Video Curso Autocad 2011 and google is still indexing. This Url i deleted from the google serps using webmater tools. It disapeared monday and today appeared again.
    Every week apperas 30 urls like this, althoug in the robots i am disallowing it.
    {{ DiscussionBoard.errors[8376228].message }}
    • Profile picture of the author yukon
      Banned
      Originally Posted by adhonys View Post

      This in one of the urls with noindex meta tags": http://www.arquigrafico.com/descargar-gratis-video-curso-autocad-2011/?replytocom=356 and google is still indexing. This Url i deleted from the google serps using webmater tools. It disapeared monday and today appeared again.
      Every week apperas 30 urls like this, althoug in the robots i am disallowing it.
      That page doesn't have a noindex tag on the Google Cache, it was also last cached on Jul 26, 2013 21:03:35 GMT, so you had to add the noindex tag after Google last cached the page. Google probably hasn't been back to that page on your site since the last time they cached the page (back in July).

      Do a page search for the word noindex of the current Google Cache HTML, there's not a noindex meta tag on the page.
      {{ DiscussionBoard.errors[8377671].message }}

Trending Topics