3 {{ upvoteCount | shortNum }}
3 {{ upvoteCount | shortNum }}

Googlebot can't access my site

by dragas
2 replies
  • SEO
    • |
I received a notification from google saying that our web site is not reachable.

Over the last 24 hours, Googlebot encountered 3 errors while attempting to access your robots.txt. To ensure that we didn't crawl any pages listed in that file, we postponed our crawl. Your site's overall robots.txt error rate is 100.0%.
i have this issue last 2 days. it started just after the godaddy's major server outage last week. couldn't solve it yet. Contacted godaddy support, however, they don't have any idea and keep saying there's nothing wrong with their settings as always.

it's weird because it was working well last week. so i am sure something changed in their configuration and this issue emerged.

I suspect that they set the security settings to highest level after that server outage and it prevents everything (including google bot) from crawling my site.
any advice will be appreciated.
#access #googlebot #site
  • Profile picture of the author yukon
    Banned
    I've been with Hostgator for a few years now & my sites have never been down. Not saying it couldn't happen, just that it hasn't ever happened.

    BTW. Hostgator has free live tech support 24/7 that is seriously very helpful, before & after you buy hosting.

    Once I had a new database table that wouldn't install, I got on HG tech support & they installed within 5min., they could have just as easily told me to deal with it myself, but the did everything for me.

    My point is, there's no reason to put up with a lazy host provider, you have options.
    {{ DiscussionBoard.errors[7015201].message }}
  • Profile picture of the author TheContentAuthority
    Dragas,

    If Googlebot cannot crawl your site, have you considered modifying or deleting robots.txt? Is there any reason why you don’ t want portions of your site indexed?

    Robots.txt is an optional file. Its purpose is to instruct search engines (and other bots) on which pages you want them to crawl. Note that a program can be made to ignore this file. Google and other major search engines abide by these files. If there is no reason to block them from some pages of your site, I would suggest just deleting the file.

    Here is an article on the basics of robots.txt,

    http://www.webconfs.com/what-is-robots-txt-article-12.php

    Hope that helps,

    Shawn
    Signature
    Outsource to the experts...

    We customize your Blog, eBook, Press Release and Sale Copy content with your message.

    {{ DiscussionBoard.errors[7022978].message }}

Trending Topics