Hostgator, addon domains, sitemap error
I am receiving the following error from google webmaster tools with an addon domain that I created through hostgator:
"Network unreachable: robots.txt unreachable
We were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely."
Has anyone ever received this error? MSN and Yahoo have no trouble crawling my site. My robots.txt is not blocking googlebot.
I have contacted hostgator to see if googlebot's ips are blocked and they said they are not. I tried taking my robots.txt file out, google still says it is being blocked by robots.txt. Checked my wordpress privacy settings, they are set to allow search engines. Checked my .htaccess file, no blocks there.
Now for the strange part. Instead of uploading my wwwdomain.com/sitemap.xml to google, I sent it as subdomain.primarydomain<dot>com/sitemap.xml and google picked up my sitemap and started crawling my site. If you type that domain into your browser, the sitemap doesn't display. I don't want to be indexed as a subdomain. Please help.
"Network unreachable: robots.txt unreachable
We were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely."
Has anyone ever received this error? MSN and Yahoo have no trouble crawling my site. My robots.txt is not blocking googlebot.
I have contacted hostgator to see if googlebot's ips are blocked and they said they are not. I tried taking my robots.txt file out, google still says it is being blocked by robots.txt. Checked my wordpress privacy settings, they are set to allow search engines. Checked my .htaccess file, no blocks there.
Now for the strange part. Instead of uploading my wwwdomain.com/sitemap.xml to google, I sent it as subdomain.primarydomain<dot>com/sitemap.xml and google picked up my sitemap and started crawling my site. If you type that domain into your browser, the sitemap doesn't display. I don't want to be indexed as a subdomain. Please help.