14 {{ upvoteCount | shortNum }}
14 {{ upvoteCount | shortNum }}

robot.txt ??? help please

by amylou78
12 replies
  • SEO
    • |
hi, I was checking my site to see if google had picked it up yet and got this

quotesquotesquotes.com website thumbnail Viewing ...

quotesquotesquotes.com/



A description for this result is not available because of this site's robots.txt - learn more.



I have added it to google webmaster, verified it, tested it with the 'crawl robot' tool thing, but not sure what this means even means or how to correct it.
does this mean my site won't be included in search results?

help please.
thanks
amy
#robottxt
  • Profile picture of the author Hemanth Malli
    Robot.txt will show you result if you r having any problem in your site with that you can clear your site with out any problems
    Signature
    Inverselogix
    CEO
    {{ DiscussionBoard.errors[9432305].message }}
  • Profile picture of the author amylou78
    hi, thanks. but I'm still not sure what this means, is my site ranking? is there something I need to do?
    Amy
    {{ DiscussionBoard.errors[9432378].message }}
    • Profile picture of the author JakeM1
      Hi, from someone else in Brighton

      To see if your website is in Google and to bring up all the pages from your website that are indexed, type the following into a Google search:

      Site:http://www.yourwebsite.co.uk

      Hope that helps
      {{ DiscussionBoard.errors[9433176].message }}
  • Profile picture of the author SEO Power
    Go to your WordPress dashboard and untick the box labeled "discourage search engines..." under reading settings. Then resubmit your site to Google.

    The reason why your site's description isn't showing up is because you are currently blocking Google from indexing your site. However, the solution I provided above might help resolve the issue.
    Signature
    ONE HOUR INDEXING - STOP WASTING MONEY ON LINKS GOOGLE NEVER FINDS
    {{ DiscussionBoard.errors[9433528].message }}
  • Profile picture of the author LuckyIMer
    Originally Posted by amylou78 View Post


    A description for this result is not available because of this site's robots.txt - learn more.
    This message means you website page has been blocked by robot.txt or was previously/recently blocked by robot.txt, you need to remove the lines from your robot.txt that are blocking the pages you want them to be indexed.
    Signature
    Increase Sales With These Business Consulting Tips !
    {{ DiscussionBoard.errors[9434560].message }}
  • Profile picture of the author amylou78
    hi, thanks for all your help, checked the 'discourage search engines' box, not clicked, resubmitted to google, can't find a fault on the robot.txt crawl thing, checked my site directly with google

    still getting this
    Quotesquotesquotes.com

    www.quotesquotesquotes.com/



    A description for this result is not available because of this site's robots.txt – learn more.


    please help, not sure what else to do.
    thanks
    amy
    {{ DiscussionBoard.errors[9436203].message }}
  • Profile picture of the author Poly Hossain
    [DELETED]
    {{ DiscussionBoard.errors[9436674].message }}
    • Profile picture of the author mivid
      Hi Amy

      The file name is ROBOTS not robot.Create a new robots.txt file and upload it to the root folder. If you have'nt done much on your webmaster account delete the existing one and re add your website into it. Then check robots.txt file in webmater tool. Also you can check it simply in browser - www.yourwebsitename.co.uk/robots.txt .

      One more thing to remember while entering URL in the required textbox of webmater tool,open your website in another tab and copy-paste the URL. Because Google considers " www.website.co.uk " and " http//website.co.uk " as different ones. I hope i have helped.
      Signature
      Check out our Latest Updates on Digital Marketing
      {{ DiscussionBoard.errors[9438810].message }}
  • Profile picture of the author elizaanderson
    hi,
    If you want to see whether google has cache your site or not. Then you should write cache:website url.
    Signature
    Website Designing Company India | Ecommerce Website Design Services
    {{ DiscussionBoard.errors[9438937].message }}
  • Profile picture of the author MikeFriedman
    Amy,

    All this means is that at one time, whether it is right now or not, your robots.txt file was blocking Google. Once Google recrawls the site and sees that the robots.txt file is no longer blocking them, Google will re-cache the site and a description will display.
    {{ DiscussionBoard.errors[9439104].message }}
    • Profile picture of the author paulgl
      Wordpress: last week I couldn't even spell webmaster, and now I is one!

      Why not just delete the robots.txt, done and done.

      Or, perhaps the site never existed, or existed for a brief moment in time.
      And now does not exist. And one wonders why google has trouble crawling
      the dang thing. So simple, and yet so far away.....

      Paul
      Signature

      If you were disappointed in your results today, lower your standards tomorrow.

      {{ DiscussionBoard.errors[9439222].message }}
  • Profile picture of the author InitialEffort
    Currently you are not hosting a robots.txt (please note my timestamp)

    Consider creating a file that looks like this:

    User-agent: *
    Allow: /
    Disallow: /cgi-bin
    Disallow: /tutorials
    Disallow: /images
    Disallow: /iframes
    Disallow: /ipcheck
    Disallow: */trackbackUser-agent: Googlebot
    Disallow: /*.js$
    Disallow: /*.inc$
    Disallow: /*.css$
    Disallow: /*.gz$
    Disallow: /*.wmv$
    Disallow: /*.cgi$
    Disallow: /*.xhtml$
    Disallow: /*.xlsx $
    Disallow: /*.doc$
    Disallow: /*.pdf$
    Disallow: /*.zip$

    User-agent: *
    Allow: /images

    User-agent: Mediapartners-Google
    Allow: /

    User-agent: Adsbot-Google
    Allow: /

    User-agent: Googlebot-Image
    Allow: /

    User-agent: Googlebot-Mobile
    Allow: /

    #User-agent: ia_archiver-web.archive.org
    #Disallow: /
    Signature
    {{ DiscussionBoard.errors[9439570].message }}
  • Profile picture of the author Tim P
    I can not access your site. Maybe robots.txt is not placed in root host
    {{ DiscussionBoard.errors[9439782].message }}

Trending Topics