11 {{ upvoteCount | shortNum }}
11 {{ upvoteCount | shortNum }}

indexed and crawling

by mathompson
11 replies
  • SEO
    • |
What is the difference between indexed and crawling?
#crawling #indexed #text deliver bonus
  • Profile picture of the author nextmashup
    Crawling is a process of fetching all the web pages linked to a website. This task is performed by a software, called crawler.

    Whereas, Indexing is a process to create index for all the fetched web pages and keeping them into a giant database from where it can later be retrieved.
    {{ DiscussionBoard.errors[10636765].message }}
  • Profile picture of the author hpasha
    Originally Posted by mathompson View Post

    What is the difference between indexed and crawling?
    Without Crawling a website a search engine cannot index your website.
    So these both points are related to each other.
    {{ DiscussionBoard.errors[10636790].message }}
  • Profile picture of the author expmrb
    When a bot comes to your site and fetch the newly updated content to the search engines that's called crawling. And when the search engines include your newly updated content to their directories, so it can be shown in the SERP's its called indexing.
    Signature
    SEO Motionz Forum & Blog- Digital Marketing Forum & Blog,
    Forum Management & Promotion, SEO Tips, Money Making tips etc.
    {{ DiscussionBoard.errors[10636795].message }}
  • Profile picture of the author TomWest
    Crawling is the process of an engine requesting - and successfully downloading of a unique URL. Obstacles to crawling include no links to a URL, server downtime, robots exclusion, or using links from which bots cannot find a valid URL.
    Indexing is the result of successful crawling. I consider a URL to be indexed (by Google) when an info: or cache: query produces a result, signifying the URL's presence in the Google index. Obstacles to indexing can include duplication (the engine might decide to index only one version of content for which it finds many nearly identical URL's), unreliable server delivery (the engine may decide to not index a page that it can access during only one-third of its attempts), and so on.
    {{ DiscussionBoard.errors[10642187].message }}
  • Profile picture of the author TopWebDeveloper
    Crawling is the process of an engine requesting — and successfully downloading — a unique URL. Obstacles to crawling include no links to a URL, server downtime, robots exclusion, or using links (such as some JavaScript links) from which bots cannot find a valid URL.

    Indexing is the result of successful crawling. I consider a URL to be indexed (by Google) when an info: or cache: query produces a result, signifying the URL’s presence in the Google index.
    {{ DiscussionBoard.errors[10652021].message }}
  • Profile picture of the author chrisjohn93
    CRAWLING
    Crawling takes place when there is a successful fetching of unique URIs which can be traced from valid links from other web pages. It’s like Pacman following all those dots and eating them, only that in the case of crawling, it’s the search engine robots that follow the links.

    INDEXING
    Indexing takes place after a crawled URIs are processed. Note that there may be several URIs that are crawled but there could be fewer of them whose content will be processed through indexing. The following reasons could be the causes of non-indexing of a previously crawled page:

    Crawling vs Indexing: What’s The Difference?
    {{ DiscussionBoard.errors[10652051].message }}
  • Profile picture of the author prathana
    Indexing is that the search engine gives preference or position on the search engine result page whereas Crawling is done by the software called Robot which means that visiting the web page

    PHP Training
    {{ DiscussionBoard.errors[10652061].message }}
  • Profile picture of the author HayleyS
    Indexing and crawling are two different stages of the same process. In indexing, Google incorporates that information into its database so that it appears in search results, in crawling, Google looks at the site and takes the data from it.
    {{ DiscussionBoard.errors[10652065].message }}
  • Profile picture of the author karen16
    Crawling and Indexing are two important words in SEO era. Every SEO experts have knowledge about crawling and indexing. These are the software which help any website to rank on search engines.
    Crawling means just follow the links and crawl the whole website while indexing is a process of adding webpages to the Google search result page.
    {{ DiscussionBoard.errors[10652067].message }}
  • Profile picture of the author rm300
    Originally Posted by mathompson View Post

    What is the difference between indexed and crawling?
    Crawling is the process of when search engine spider come to your website and download data.
    Indexing is the result of successful Crawling, when search engine download your website data, it save it in there database (Index).
    {{ DiscussionBoard.errors[10652260].message }}
  • Profile picture of the author EmilyS
    Crawling is the process when a search engine crawler comes to your website to crawl its content and links for usefulness, while indexing is the process when a search engine finds your website good enough to add into its index for future reference when someone searches for the similar content search engine shows your website in search results.
    {{ DiscussionBoard.errors[10658563].message }}

Trending Topics