Network unreachable: robots.txt unreachableWe were unable to crawl your Sitemap because.......

by TODU
5 replies
  • SEO
  • |
I have errors on my blogs:

Network unreachable: robots.txt unreachableWe were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely.

how to fix this problem? I using plugin Google XML Sitemaps
#crawl #network #robotstxt #sitemap #unable #unreachable #unreachablewe
  • TODU,

    You could either login to your site via an FTP client and remove robots.txt (or reconfigure it) or you could contact your hosting provider and have them do it for you.

    Also, you might be able to find an answer here,

    Google can't access sitemap.xml and robots file? « PremiumPress Community Forum

    Best,

    Shawn
    Signature
    Outsource to the experts...

    We customize your Blog, eBook, Press Release and Sale Copy content with your message.

    {{ DiscussionBoard.errors[7634220].message }}
  • Profile picture of the author Punit12
    Originally Posted by TODU View Post

    I have errors on my blogs:

    Network unreachable: robots.txt unreachableWe were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely.

    how to fix this problem? I using plugin Google XML Sitemaps
    Dear TODU,

    Your first Line says "Network unreachable:", this means that,
    the time when Google bot visited your robot.txt for crawling/indexing
    Your Site was DOWN.

    To solve this problem,
    1. Ensure that your site is always up. (Check you hosting uptime)
    2. Through FTP you may upload robot.txt/XML sitemap & resubmit using webmasters.

    This will solve your problem.

    Thanks.
    Signature

    Punit Kansara
    Seo Strategist

    {{ DiscussionBoard.errors[7636611].message }}
    • Profile picture of the author TODU
      Originally Posted by Punit12 View Post

      Dear TODU,

      Your first Line says "Network unreachable:", this means that,
      the time when Google bot visited your robot.txt for crawling/indexing
      Your Site was DOWN.

      To solve this problem,
      1. Ensure that your site is always up. (Check you hosting uptime)
      2. Through FTP you may upload robot.txt/XML sitemap & resubmit using webmasters.

      This will solve your problem.

      Thanks.
      yes, site was down but sitemap already not working
      {{ DiscussionBoard.errors[7641310].message }}
      • Profile picture of the author Punit12
        Originally Posted by TODU View Post

        yes, site was down but sitemap already not working
        Dear TODU,

        Considering your site is hosted on a good server & is up.

        Now there may be a problem in the xml code of your sitemap.

        You can generate an error free sitemap with this,

        Create your Google Sitemap Online - XML Sitemaps Generator

        Again, before you submit your sitemap, In webmasters there is an option to test it, if its error free just submit it.

        Ensure that your robots.txt file is accessible,

        You can refer below eg:
        www.YOURSITE.com/robots.txt

        Check once again.

        All the best.
        Signature

        Punit Kansara
        Seo Strategist

        {{ DiscussionBoard.errors[7641376].message }}
        • Profile picture of the author TODU
          Originally Posted by Punit12 View Post

          Dear TODU,

          Considering your site is hosted on a good server & is up.

          Now there may be a problem in the xml code of your sitemap.

          You can generate an error free sitemap with this,

          Create your Google Sitemap Online - XML Sitemaps Generator

          Again, before you submit your sitemap, In webmasters there is an option to test it, if its error free just submit it.

          Ensure that your robots.txt file is accessible,

          You can refer below eg:
          www.YOURSITE.com/robots.txt

          Check once again.

          All the best.
          I try but it not working

          I will sent you pm robots.txt and sitemap and if you have time please check it
          {{ DiscussionBoard.errors[7647536].message }}

Trending Topics