Question about Adsense and Robots.txt

by mariek
1 replies
  • SEO
  • |
The report in my google adsense account shows that I have some blocked url. There is an instruction on what I should do to enable them to crawl this url. I am using wordpress so I install a plugin to get a robot.txt.

My question is what should I write in my robot.txt. Should I allow all robots to crawl my url or should I allow only googlebot?

I am kinda confused.
#adsense #question #robotstxt
  • Profile picture of the author bigcat1967
    Allow all bots to crawl your site - therefore, you don't have to put anything in the robot.txt file.
    Signature

    <a href="https://changeyourbudget.com/save-money-on-your-water-bill/">How to Lower Your Water Bill</a>

    {{ DiscussionBoard.errors[1715203].message }}

Trending Topics