Informative: Important to know

by androidapps Posted: 14 years ago 4 replies

All of us are aware with the terms spiders, crawlers and bots (robots), however very few people know the difference among the three.

Here is the short description the reveals the difference:

Spider - a browser like program that downloads web pages.

Crawler - a program that automatically follows all of the links on each web page.

Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task. They can combine the tasks of crawler & spider together and help in indexing and ranking of websites on any particular search engine.

#search engine optimization #crawlers #difference #important #informative #robots #spider

samual james 14 years ago

i have a quick question for you, what is the preferred method to get indexed by yahoo
funeral Banned 14 years ago

[DELETED]
nicktyler 14 years ago

So by that definition Spiders and Crawlers probably don't really exist in their individual form anymore. It will all be about the robots.

Doesn't it also depend a bit on the common perceived definitions of these things. Words can have their meanings changed and merged by popular use as in the case of calling a vaccum cleaner a Hoover. I think for the most part all three of these things have become understood as pretty much the same.
UMS 14 years ago

Web crawler - Wikipedia, the free encyclopedia
quickcontent 14 years ago

thanks for the enlightenment
peterdavid167 Banned 14 years ago

[DELETED]

Join the discussion

Next Topics on Trending Feed

5

Informative: Important to know

androidapps • 14 years ago • 4 replies

All of us are aware with the terms spiders, crawlers and bots (robots), however very few people know the difference among the three. Here is the short description the reveals the difference: