So if you had user agent as * and disallow to / it applies to all bots BUT googlebot? As googlebot needs it's own rules? Seems there's some misinformation out there. Anybody clear it up?
Googlebot unaffected by * in robots.txt?
9
So if you had user agent as * and disallow to / it applies to all bots BUT googlebot? As googlebot needs it's own rules?
Seems there's some misinformation out there. Anybody clear it up?
Seems there's some misinformation out there. Anybody clear it up?
- HunterSnake
- millerb7
- HunterSnake
- millerb7
- HunterSnake
- millerb7
- HunterSnake
- [1] reply
- millerb7
Next Topics on Trending Feed
-
9