Removing Links from Search Engine

by Simo
14 replies
  • WEB DESIGN
  • |
Hey Warriors,

I've designed a wordpress site using JVPress. For some reason these two links are showing up on Google:

websitename/author/andrew

websitename/category/uncategorized

How do I find these links from within Wordpress and remove them so they do not show up in the search results?:confused:


Many thanks,

Andrew
#engine #links #removing #search
  • Profile picture of the author gtownfunk
    Google 'robots.txt'
    Signature
    {{ DiscussionBoard.errors[4934463].message }}
  • Profile picture of the author mgreener
    Hi Andrew,

    Setup a robots.txt file if you haven't yet and place this text:

    User-agent: *
    Disallow: /author/
    Disallow: /category/

    This will tell search engines not to index that content.
    There are also plugins that can be configured to do this. All In One SEO adjusts to noindex categories and archives, but not the author pages.
    {{ DiscussionBoard.errors[4934465].message }}
  • Profile picture of the author Simo
    Thanks guys - Appreciate your feedback. I'll work on this tonight. One questions - Should The robots.txt file should go in the public_html folder?

    Cheers
    Signature
    Need quality adwords training? The adwords antidote gives you the tools to avoid the Google Slap. Click here to learn more.

    {{ DiscussionBoard.errors[4937417].message }}
  • Profile picture of the author Hafeez
    Yes robot.txt file should be in root of your website e.g. 'public_html'
    {{ DiscussionBoard.errors[4937717].message }}
  • Profile picture of the author Simo
    Bingo - thanks Scott. That Plugin is the business
    Signature
    Need quality adwords training? The adwords antidote gives you the tools to avoid the Google Slap. Click here to learn more.

    {{ DiscussionBoard.errors[4944340].message }}
  • Profile picture of the author ammyjohn123
    You can also place the No-Index and No-Follow Tag on a page. This tag specially used for the single page problem so if you have more two or more pages then use robots.txt file to disallow the search engines to not crawl your website.
    {{ DiscussionBoard.errors[4945052].message }}
  • Profile picture of the author plepco
    Don't forget Webmaster tools. Add your site, verify it, and then go to Site Configuration and then Crawler Access. There's a link there to "Remove URL". Simply submit the URL(s) you want to have removed from search results.
    {{ DiscussionBoard.errors[4945159].message }}
  • Profile picture of the author samurairey
    just remove your link in sitemap and also you can use your .htaccess too.
    {{ DiscussionBoard.errors[4945775].message }}
  • Profile picture of the author nahids
    Yes!! Google Robot.txt
    {{ DiscussionBoard.errors[4956566].message }}
  • Profile picture of the author johnny125
    I also vote for WordPress SEO by Yoast.
    Simo since you are looking for easy change - robots.txt is the right sollution for you.
    But if you would like to dissallow bots to view more of subpages - you should get back to WordPress SEO plugin.

    By the way - personally I had some time ago a huge problem to setup robots.txt on one of cheap hosts. Till today I don't know why this was not working correct. Since I have moved my webiste to another host everything started to work without any problems.
    {{ DiscussionBoard.errors[4956662].message }}
  • Profile picture of the author mikeavery10
    Disallow the panda on robot.txt file. It will not crawl your site.
    {{ DiscussionBoard.errors[4956773].message }}
  • Profile picture of the author amritrr
    You can use both robots.txt and Webmaster tools to remove these two pages. However, make sure that you also actually remove them from your site too. You should remove that particular author and there is also you should delete the "uncategorized" category from your blog or site. That way they will not show up in future in other search engines too.
    {{ DiscussionBoard.errors[4958062].message }}
  • Profile picture of the author johnny125
    Maybe good solution is not to remove the pages, but just change theirs names that google will remove them from search index
    {{ DiscussionBoard.errors[4958122].message }}

Trending Topics