How to Stop Search Engine Crawling Database?
How can I block bots from crawling the survey?
I've blocked via robots.txt but it still doesn't matter. I thought since this is my database the spider needs password access.
-
Karen Blundell -
[ 1 ] Thanks
Signature---------------{{ DiscussionBoard.errors[3998022].message }} -
-
JayGreen -
Thanks
{{ DiscussionBoard.errors[3999175].message }} -