htaccess or robots.txt throughing out Google bot?
- SEO |
Hi,
I am doing some SEO on a site, and here's the robots.txt
Looks fine doesn't it?
The site is not visible in Google. The only way to get it to show is if you search for the url (must be the full URL, such as example.com (.com needs to be there for the site to show)).
Could it be the htaccess file which is set wrong?
How would I check that file (I am not a webmaster of the site), so I would need to check it externally.
I am doing some SEO on a site, and here's the robots.txt
|
User-Agent: * Allow: / Disallow: /cgi-bin Disallow: /go/ Disallow: /ajax/ |
The site is not visible in Google. The only way to get it to show is if you search for the url (must be the full URL, such as example.com (.com needs to be there for the site to show)).
Could it be the htaccess file which is set wrong?
How would I check that file (I am not a webmaster of the site), so I would need to check it externally.