hi gwt says my robot.txt file is User-agent: *
robots.txt
0
hi gwt says my robot.txt file is
User-agent: *
Disallow:
this allows googlebot to crawl site? correct... Because gwt says 16 of my pages are restricted... I used to have wp set to privacy but changed that.... could this be affecting that... Info on robot files are very confusing so thought I'd ask directly.. Thanks in advance..rob
User-agent: *
Disallow:
this allows googlebot to crawl site? correct... Because gwt says 16 of my pages are restricted... I used to have wp set to privacy but changed that.... could this be affecting that... Info on robot files are very confusing so thought I'd ask directly.. Thanks in advance..rob
Next Topics on Trending Feed
-
0