3 replies
I have about 5 websites that I can't indexed with Google because a "robot.txt" file is prohibiting access. These are all WP sites.

I've researched and found someone you can remove the robot.txt file somehow. However, I can't find the stinkin file to remove it.

Can anyone give me a hand with this?

Thanks in advance!
#file&gthelp #file>help #robottxt
  • Profile picture of the author The Pension Guy
    If they are WP sites, most likely they don't have a robots.txt file but in the head section they have the meta tag noindex,nofollow...

    Check the Settings > Privacy and make sure it is set to allow search engines to find you.
    Signature

    {{ DiscussionBoard.errors[1315815].message }}
  • Profile picture of the author SoEasyMoney
    Thanks Pension. I did change the privacy settings and they were actually set to not allow the crawlers. I'll go in and look at the meta tags and see what's there.
    {{ DiscussionBoard.errors[1315826].message }}
  • Profile picture of the author The Pension Guy
    When you change those settings... the "forbidding" meta tags will disappear which means no need to mess with the meta tags.
    Signature

    {{ DiscussionBoard.errors[1315831].message }}

Trending Topics