Can googlebot miss pages

3 replies
Can googlebot miss newly created pages that are interlinked on the site and not blocked by a robots.txt file?

I'm just asking because I'm curious if anyone has seen googlebot miss pages
#googlebot #miss #pages
  • Profile picture of the author SeoKungFu
    Originally Posted by Delta223 View Post

    Can googlebot miss newly created pages that are interlinked on the site and not blocked by a robots.txt file?

    I'm just asking because I'm curious if anyone has seen googlebot miss pages
    Yes, often especially when the bot is drunk.
    Now, seriously - yes, it simply happens all the time. Build more links from outside and it will help them a lot !
    {{ DiscussionBoard.errors[6330489].message }}
  • Profile picture of the author wabbie
    Originally Posted by Delta223 View Post

    Can googlebot miss newly created pages that are interlinked on the site and not blocked by a robots.txt file?

    I'm just asking because I'm curious if anyone has seen googlebot miss pages
    You should add it to your sitemap, it will not miss those links verry often.
    {{ DiscussionBoard.errors[6330534].message }}
  • Profile picture of the author Streamforline
    It sure can if it deem them unimportant.
    {{ DiscussionBoard.errors[6330549].message }}

Trending Topics