What is Crawl-Delay ?
- SEO |
Can you please define crawl delay. I have seen Crawl-delay: 10 in robots.txt file, What does it mean??
Thanks!
-
Steve Michael -
Thanks
{{ DiscussionBoard.errors[6217268].message }} -
-
aegisisc Banned{{ DiscussionBoard.errors[6217702].message }}-
SamDenial -
Thanks
{{ DiscussionBoard.errors[6296721].message }} -
-
-
landen Banned-
Thanks
{{ DiscussionBoard.errors[6297418].message }} -
-
JohnMCarter -
Thanks
{{ DiscussionBoard.errors[6297581].message }} -