11 {{ upvoteCount | shortNum }}
11 {{ upvoteCount | shortNum }}

What is crawl error?

by Anoopchawla
8 replies
hey there, today I noticed when logged into to my webmaster tool on the right hand side under crawl errors my site shows 58 unreachable pages.

So does that mean google has some problem reaching those pages if yes it could ruin my rankings.

What should I do?

hey there, today I noticed when logged into to my webmaster tool on the right hand side under crawl errors my site shows 58 unreachable pages.

So does that mean google has some problem reaching those pages if yes it could ruin my rankings.

What should I do?

Also when I try to set my preffered URL from wwwdotelectromandidotcom to electromandidotcom it shows a strange message that says
art of the process of setting a preferred domain is to verify that you own wwwdotelectromandidotcom. Please verify wwwdotelectromandidotcom

Strange because I have already verifies my site 2 months ago.
#crawl #error
  • Profile picture of the author Sillysoft
    Yes it means Google couldnt get to those pages. I cant see the actual errors and urls it cant reach but you might want to try using 301 redirects to redirect the unreachable pages back to your regular site, that way if traffic is hitting those pages instead of getting a 404 error they get right back on your site. But it all depends on if those are legitimate pages or not or just google having problems just seeing the pages.
    {{ DiscussionBoard.errors[5458413].message }}
    • Profile picture of the author IAmPaulJames
      Originally Posted by Sillysoft View Post

      Yes it means Google couldnt get to those pages. I cant see the actual errors and urls it cant reach but you might want to try using 301 redirects to redirect the unreachable pages back to your regular site, that way if traffic is hitting those pages instead of getting a 404 error they get right back on your site. But it all depends on if those are legitimate pages or not or just google having problems just seeing the pages.
      I would research into each those links individually and find out what happened. If you had content there that got deleted try searching for it in Google and see if they have a cached version. You might be missing out on a lot of traffic on a term people were searching for.
      {{ DiscussionBoard.errors[5458422].message }}
      • Profile picture of the author Sillysoft
        Originally Posted by IAmPaulJames View Post

        I would research into each those links individually and find out what happened. If you had content there that got deleted try searching for it in Google and see if they have a cached version. You might be missing out on a lot of traffic on a term people were searching for.
        Yep, like I said it depends on if those are legit pages are not. If they are legit either fix them or use 301 redirects so you dont lose traffic.
        {{ DiscussionBoard.errors[5458488].message }}
  • Profile picture of the author sandebdavid
    I get such errors occasionally mostly when the robots crawl my back links. It usually happens when there is an error in the URL so when robots start to crawl and fail when they encounter that point of error.

    E.g. If your URL is written like: www.abc.com/efg.htmlABC instead of www.abc.com/efg.html Notice the extra characters after the .html extension. That causes a crawl error because it is not part of normal URL.
    Signature
    "For everyone somewhere there is a piece of heaven on earth"
    {{ DiscussionBoard.errors[5458507].message }}
  • Profile picture of the author mrketing.me
    It is as you mentioned, unreachable pages!

    Note that they might be the admin panel pages (depending on your website system if you have nay) or pages in a secured directory

    If you are using a CMS such Joomla or WP try to search for SEO or statistics plugins that re-form the URL's and generate site maps. if not, you will have to do it manually.

    Things that can help
    - If you don't know which pages have the error, use a tool like google webmaster tools to send a crawler to your website and see what it can/cannot retrieve

    - Check your pages, search for pages that has special or invalid characters in their address (file name when you are browsing the server)

    - Make sure that all pages end in a valid extension, PHP, HTML, ASP,...


    Best of luck
    {{ DiscussionBoard.errors[5458812].message }}
  • Profile picture of the author opt4achange
    What is crawl error?

    Insufficient subservience in the presence of your boss.
    {{ DiscussionBoard.errors[5458894].message }}
    • Profile picture of the author rusha
      If the pages dont exist dont worry about it. Google will remove the 404 warnings just give them some time.

      So if another random website links to your 404 page is it a problem? Answer = only if that website is important to you.

      As for your internal links pointing to a 404 webpage - maybe the information you see in webmaster tools is outdated?

      Check the links manually to see if they point to a 404 or if the link even exists anymore.

      Webmaster Tools is not updated in real time.
      {{ DiscussionBoard.errors[5458920].message }}
      • Profile picture of the author rusha
        Visit page google.com/support/forum/p/Webmasters/thread?tid=2241a7273675780b&hl=en to get more answers
        {{ DiscussionBoard.errors[5458935].message }}

Trending Topics