What is the difference between crawling and indexing in SEO ?

18 replies
  • SEO
  • |
What is the difference between crawling and indexing in SEO??
Can anyone tell me ??
#crawling #difference #indexing #seo
  • Profile picture of the author gamebak
    indexing is when a page gets into search engines, and crawling is the process when the page gets fetched
    {{ DiscussionBoard.errors[6880166].message }}
    • Profile picture of the author Aarav
      Crawling means the search engine robot crawl or fetch the web pages while Indexing means search engine robot crawl the web pages, saved the information and it appear in the search engine.
      Signature

      For Ethical SEO Services, Visit : www.imphilosopher.com

      {{ DiscussionBoard.errors[6880331].message }}
  • Profile picture of the author alexmw106
    Once google has crawled the website it will see how relevant it is and if it worth indexing so it shows up in the search.
    Signature

    Alex Maggs-Wellings

    Free 30 Minute SEO Consultation PM for Details...

    SEO Denver

    {{ DiscussionBoard.errors[6880467].message }}
  • Profile picture of the author gracyluther
    Crawling means the search engine optimization robot crawl or fetch the web pages while Indexing means search engine optimization robot crawl the web pages, saved the information and it appear in the search engine optimization.
    {{ DiscussionBoard.errors[6891351].message }}
  • Profile picture of the author solarpanel2
    A web directory could be likened to the traditional yellow phone book directory. With a web directory, you have a bunch of websites that are placed in various categories. When you click on the category page, you will have a list of websites. Each website will have a title that comes in the form of a link, and they will all have descriptions which tell you what the site is about. By reading these descriptions, you will be able to determine whether or not you're interested in visiting the website. Link farms are the exact opposite.
    {{ DiscussionBoard.errors[6891697].message }}
    • Profile picture of the author yang77win
      Originally Posted by solarpanel2 View Post

      ... Each website will have a title that comes in the form of a link, and they will all have descriptions which tell you what the site is about. By reading these descriptions, you will be able to determine whether or not you're interested in visiting the website. Link farms are the exact opposite.
      I though the category, is based on a the robot finding keywords in the website text that are predefined to a specific category. What carries more importance the title/description or the website contents?
      {{ DiscussionBoard.errors[6896781].message }}
  • Profile picture of the author webdevpro
    Crawling means to visit the link by SEs and indexing means to put the page contents in DB (after analysis) and make them available in search results when a request is made.
    {{ DiscussionBoard.errors[6892707].message }}
  • Profile picture of the author kazim
    When search engine crawlers visit any link is called crawling and when crawlers save or index that links in search engine database is called indexing.
    {{ DiscussionBoard.errors[6896228].message }}
  • Profile picture of the author aadi144
    Crawling is the process through which indexing is done.Google crawlers crawls through the webpages and index the pages.
    {{ DiscussionBoard.errors[6896457].message }}
  • Profile picture of the author zylun
    I agree with aadi114, crawling is the process while index page is the cache of the crawled page.
    Signature
    SEO and Web Design Outsourcing Company
    Call Us Today 801-331-8770
    Zylun Offshore Staffing Solutions is your perfect outsourcing partner.
    {{ DiscussionBoard.errors[6896477].message }}
  • Profile picture of the author Josh Jocky
    Crawling means, visiting the websites which may be visited already or not but indexing means, updating the pages in search engines if its already indexed, it just updates the page or if its new to crawler, it informs search engines to index that webpage. I hope, i didnt confuse..
    Signature
    >>>>> Private Blogs - Public Links <<<<<

    >>>>>>> Our links - Your Traffic <<<<<<<

    ------------------------------------------------------------>>>>> Meet my Website - Get me a Try <<<<<
    {{ DiscussionBoard.errors[6896724].message }}
  • Profile picture of the author marian004
    by crawling, the SE visits all links on your page . with these results they index your page accordingly
    {{ DiscussionBoard.errors[6897173].message }}
  • Profile picture of the author fmnely1
    I LOVE THIS THREAD AND WHAT MORE CAN I SAID ,SIMPLE ADDITION ..WHEN CRAWLER GET NEW CONTENT IN YOUR BLOG SITE REGULARLY THEY END TO COME FOR MORE REGULARLY AND WITH A GOOD PR FROM YOUR MAIN DOMAIN GETTING TRENDING INFORMATION FROM YOUR NICHE WILL GET YOU ON TOP ALWAYS
    Signature
    Long Kept Guru Secret Traffic Heaven Download :Now http://www.filedropper.com/trafficheaven
    {{ DiscussionBoard.errors[6976774].message }}
  • Profile picture of the author K Mec
    Google first crawls and then indexes..simple...
    {{ DiscussionBoard.errors[6977020].message }}
  • Profile picture of the author Dragoo
    Crawling is where search engines spiders / bots move from web page to web page by following the links on the pages. The pages "found" are then ranked using an algorithm and indexed into the search engine database. (Google sends its spiders to your website)

    Indexing is where search engine has crawled the web and ranks the URLs found using various criteria and places them in the database, or index. (Google visited your website and has added you to its database) CMIIW
    {{ DiscussionBoard.errors[6977639].message }}
  • Profile picture of the author sbluford
    Crawling is when the spider bots browse through your site and check the relevancy of your content to your actual keywords

    Indexing put simply is when your site or content is posted on the SE itself and is visible for the public to see.

    If your site isn't indexed in the SE's then it won't be found when people search the SE's for your keywords.
    {{ DiscussionBoard.errors[6978479].message }}
  • Profile picture of the author CyborgX
    Crawling means sucking content without processing the results. Crawlers are rather dumb processes that fetch content supplied by Web servers answering (HTTP) requests of requested URLs, delivering those contents to other processes, e.g. crawling caches or directly to indexers.

    Indexing means making sense out of the retrieved contents, storing the processing results in a (more or less complex) document index. Link analysis is a way to measure URI importance, popularity, trustworthiness and so on.
    {{ DiscussionBoard.errors[7255146].message }}
  • Profile picture of the author tjaysen70
    yeah the crawling of your site is done by the google bots, or robots, that crawl your site and then gather sites content, and then google indexes your sites content into their database.
    Signature

    Tired of the grind? Wait. PM me to see a better way.

    {{ DiscussionBoard.errors[7255209].message }}
  • Profile picture of the author wingersolutions
    [DELETED]
    {{ DiscussionBoard.errors[10094862].message }}

Trending Topics