Robot txt images have been disallowed, without setting it???

4 replies
  • SEO
  • |
Hi All,
I have been notified by Google merchant that my images have been disallowed for them to crawl. However, I have not set a disallow to it! I have added an allow to the robot.txt file, but wonder if I am missing something for the robot text file. Any help or advice on my file would be great.
https://limetec.co.uk/robots.txt
Thank you in advance.
#disallowed #images #robot #setting #txt
  • Profile picture of the author paulgl
    That robots.txt is just bad.

    I am not even going to decipher it. You could have a number of things screwed up, from punctuation to order.

    My advice is to leave it blank.

    Anyway, a lot of those messages from google are stock messages, and are not exactly what might be going on. They look for things, and if it's not there, they send a stock message that covers general settings.

    Sometimes it's a server issue. Sometimes it's hosting.

    A lot of times when google sends a robots.txt message, it's due to your site not being able to be crawled due to other issues. If they can't crawl anything, sometimes you get a robots.txt message, and it's got nothing to do with it.

    As I said, your file is just one big piece of sewage. Who could ever decipher it?

    Leave it blank. Contrary to popular belief, you don't really need to block anything. There's no point. Just the top few lines of yours are just over the top and unneeded. Finding what is blocking what, when, where, and why, in yours, would not be worth the effort. Leave it blank.

    Paul
    Signature

    If you were disappointed in your results today, lower your standards tomorrow.

    {{ DiscussionBoard.errors[10838547].message }}
  • Profile picture of the author rohitkumary
    Open the root directory of your website and search for the Robot.txt and edit it.
    {{ DiscussionBoard.errors[10838717].message }}
  • Profile picture of the author yukon
    Banned
    Nobody is going to read 870 lines on a robots.txt file.

    For all we know you're blocking Google from your images in a .htaccess file.
    {{ DiscussionBoard.errors[10840536].message }}
    • Profile picture of the author jaykay192
      Thank you for the advice, why is it so bad, most of the information has come for reading up articles? Could you recommend a place or tutorial for me to use?
      {{ DiscussionBoard.errors[10840776].message }}

Trending Topics