SEO Error

by 16 replies
20
I am having a serious problem with my blog's mobile version. When i take Google's mobile friendly test it says "The requested URL redirected to How Cancer Kills which is disallowed by robots.txt." Please help me to fix this issue.

Thank you

Regards
Rihsam
#search engine optimization #error #seo
  • Edit your robots.txt file:

    http://www.howcancerkills.com/robots.txt

    Code:
    User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Disallow: /?m=0 Disallow: /?m=1 Allow: / Sitemap: http://howcancerkills.com/atom.xml?redirect=false&start-index=1&max-results=500
    That's a mess and isn't doing what you think, for example you are disallowing your categories (they are under the URLs /search/) which means Google doesn't index them which means they aren't passing SEO link benefit through the site!!!

    I recommend deleting the content of the entire file, save it and upload so you have a blank robots.txt file.

    Your robots.txt file is a good example how to damage your own SERPs!

    If there's sections of the site you want to disallow what are they and why?

    David
    • [ 1 ] Thanks
  • What's really funny (from an SEO perspective) is the site has the useful categories blocked and the almost useless dated archives indexable!

    Where ever you got your SEO info from, stay away from that source.

    David
    • [ 1 ] Thanks
    • [1] reply
  • If i were you, i would delete your robots file and start again.

    Are you using any sort of CMS like Wordpress?
    • [ 1 ] Thanks
    • [1] reply
    • I am using Blogger platform
  • Why are you still disallowing /search?

    Those are your categories, you are shooting your site in the foot SEO wise.

    Your current robots.txt file is SEO damaging, there is nothing useful in it, delete it.

    Are you using the blogger custom robots.txt options https://support.google.com/blogger/answer/2472627?hl=en Can you remove /search? Can you use an empty robots.txt file?

    David
    • [ 1 ] Thanks
    • [1] reply
  • go into browser type your url /robots.txt . find the disallow text there. and change it to allow
    • [ 2 ] Thanks
  • Looked at one of the articles you linked to which says this:

    That tells use the person who wrote the article doesn't know shit about SEO.

    The * is a wild card, no search engine spider is marked with a *. That makes no sense.

    What User-agent: * really means is ALL search engine spiders follow the next set of rules.

    This is what a robots.txt file should look like:

    http://stallion-theme.co.uk/robots.txt

    Code:
    User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /go/
    I want all search engine spiders (*) to not includes anything under these three directories:
    wp-admin and wp-includes are WordPress admin directories, there's nothing under those folders I want indexing.

    The go folder holds my affiliate links, I use a PHP script to link to affiliate sites using a 302 redirected webpage and I don't want those webpages indexed by Google etc...

    All my categories are indexed by all search engines.

    David
    • [ 1 ] Thanks
    • [1] reply
    • [DELETED]
    • Man I've never heard o' somebody havin' so many problems with robots.txt

  • This is our latest design pakistan dress design site India Pakistani,mobile phone health beauty cosmetics fashion designs and much more is available.
  • Free India Actress Wallpapers Latest Priyanka Chopra Pictures very cute and beautyfull wallpapers.Free India Actress Wallpapers Priyanka Chopra Wallpaper very cute and beautyfull wallpapers.
  • [DELETED]
Join the discussion

Next Topics on Trending Feed

  • 20

    SEO Error

    I am having a serious problem with my blog's mobile version. When i take Google's mobile friendly test it says "The requested URL redirected to How Cancer Kills which is disallowed by robots.txt." Please help me to fix this issue. Thank you