Can google crawl without a site map

19 replies
  • SEO
  • |
Interestingly : The Interests Community

This is my site and I think I have done everything I can but wonder if google can crawl all the content with no sitemap? Will the categories on the left be viewable by google?
#crawl #google #map #site
  • Profile picture of the author xbluelinks
    Yes it can.

    But it will be slower than if you submit your sitemap to Google Webmasters Tool. (based on my personal experience with numerous sites)
    {{ DiscussionBoard.errors[6729751].message }}
  • Profile picture of the author darrenlc
    As long as you have some links pointing to your site then Google will follow them in and then follow your internal links unless of course you tell it not to. Html sitesmaps and xml sitesmaps would help you more though.
    Signature
    {{ DiscussionBoard.errors[6729917].message }}
  • Profile picture of the author oliverjones
    But I can't tell if my internal linking is ok?
    {{ DiscussionBoard.errors[6729990].message }}
  • Profile picture of the author wlasikiewicz
    Yes they can but a sitemap make life alot easier for google and your website to be indexed
    {{ DiscussionBoard.errors[6729998].message }}
  • Profile picture of the author darrenlc
    Type sitesmap generator into Google. Create one and submit it in your Google webmaster tools.
    Signature
    {{ DiscussionBoard.errors[6730079].message }}
    • Profile picture of the author paulgl
      Complete nonsense. You don't need a sitemap.
      In fact, just the opposite is true. If you NEED
      a sitemap, your site structure is lame.

      A sitemap has never been required, and if you
      have a large site, it's impossible to keep up.

      A sitemap is just one of those voodoo SEO
      things, that do nothing.

      If google needs a sitemap to crawl your site,
      man you have problems.

      You think the WF has a sitemap? These threads
      are crawled instantly as soon as you create them.
      The WF does not need a sitemap, for the same reason
      that no other site should need a sitemap.

      There is nothing magic about a sitemap, but it sounds
      better than "hard work."

      Paul
      Signature

      If you were disappointed in your results today, lower your standards tomorrow.

      {{ DiscussionBoard.errors[6730115].message }}
      • Profile picture of the author oliverjones
        So do you think my site is crawlable?
        {{ DiscussionBoard.errors[6730407].message }}
      • Profile picture of the author banx63
        Originally Posted by paulgl View Post

        Complete nonsense. You don't need a sitemap.
        In fact, just the opposite is true. If you NEED
        a sitemap, your site structure is lame.

        A sitemap has never been required, and if you
        have a large site, it's impossible to keep up.

        A sitemap is just one of those voodoo SEO
        things, that do nothing.

        If google needs a sitemap to crawl your site,
        man you have problems.

        You think the WF has a sitemap? These threads
        are crawled instantly as soon as you create them.
        The WF does not need a sitemap, for the same reason
        that no other site should need a sitemap.

        There is nothing magic about a sitemap, but it sounds
        better than "hard work."

        Paul
        The Google crawlers are on the warrior forum permenantly thats why the forum does not need a sitemap. For small to medium sites they are good practice, not essential but better than not having one.
        Signature
        Message me about joining our secret Viral Sites Clan on Facebook (not for newbies)
        {{ DiscussionBoard.errors[6776921].message }}
  • Profile picture of the author darrenlc
    Otherwise type site:www.yourwebsitename.com and it will bring back a list of pages that are indexed for your site. If you get what you expect then you'll know if you internal link structure is ok or not.
    Signature
    {{ DiscussionBoard.errors[6730102].message }}
  • Profile picture of the author matthewjudd
    Yes.. Google crawler can crawl your sites and other pages of your site, but it takes time than sitemap. Sitemap is important, because crawler can get all the important links of your site from one place. So it will crawl your website pages faster.
    {{ DiscussionBoard.errors[6741355].message }}
    • Profile picture of the author innpacked
      Yes Google crawl whole website without sitemap. if you having a sitemap in your website root directory crawler can read whole website structure easily. It also helps to make user friendly websites.
      {{ DiscussionBoard.errors[6741463].message }}
  • Profile picture of the author hilarious89
    Yes, if you submit your website to Google webmaster tool. Google will automatically create sitemaps for your site.
    Signature
    My Archive :- A blog where you will get everything updated !
    Get Walkthrough Videos of Newly Released Games from Entertainment Discuss!!
    {{ DiscussionBoard.errors[6741556].message }}
  • Profile picture of the author carlamax
    Google can crawl your site if you have been use webmaster tool.
    {{ DiscussionBoard.errors[6741615].message }}
  • Profile picture of the author danielthomas
    Google bot can crawl a page or site in many ways. Through back links, sitemap, adding url to Google and so on. Having a sitemap is added as an advantage.
    {{ DiscussionBoard.errors[6741656].message }}
  • Profile picture of the author denharsh
    Indeed it wil...If Google find your site by any ways like Ping, link from other site or any other ways..
    Though having a sitemap helps Google understand all your links and also by submitting sitemap to Google, you inform them about new site...
    {{ DiscussionBoard.errors[6741719].message }}
  • Profile picture of the author SamDenial
    Yes Google crawler can crawl your website without sitemap but crawler will fetch random website pages. In sitemap it tells step by step about your web pages to crawlers.
    {{ DiscussionBoard.errors[6742179].message }}
  • Profile picture of the author sanjaykumar
    Banned
    [DELETED]
    {{ DiscussionBoard.errors[6742643].message }}
  • Profile picture of the author sureshgupta
    Yes, Google can crawl web pages without xml sitemap. For this Google needs only on dofollow link to reach the page and If the content is original then GOogle loves to get index that page.
    Signature

    Need Quality Links? Try our guest blog posting service check our my blog The Lovers Point.com

    {{ DiscussionBoard.errors[6777049].message }}
  • Profile picture of the author rahmanpaidar
    You can't change any facts by submitting sitemap to google and pretend your
    now-indexed-pages are good enough to get ranked.

    If your site needs sitemap to get its new page indexed, then you have a serious internal
    linking pattern problem on your site.

    You have two options at your disposal:

    1) You can fix your internal linking pattern,
    2) You can submit a new sitemap every 10 seconds to Google
    {{ DiscussionBoard.errors[6777376].message }}

Trending Topics