Is the right way to allow google adsense crawler

0 replies
  • SEO
  • |
Hello everyone, I got a message from adsense about crawling failure and the problem was robots.txt as mentioned

previously my robots.txt was :

User-agent: Mediapartners-Google

User-agent: *

but now I have changed that to

User-agent: Mediapartners-Google
Disallow:

User-agent: *


Is there really any difference between the above two.
Also I want to know if this is the correct way to allow adsense and other search engine
Thanks
#adsense #crawler #google

Trending Topics