Informative: Important to know
- SEO |
All of us are aware with the terms spiders, crawlers and bots (robots), however very few people know the difference among the three.
Here is the short description the reveals the difference:
Spider - a browser like program that downloads web pages.
Crawler - a program that automatically follows all of the links on each web page.
Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task. They can combine the tasks of crawler & spider together and help in indexing and ranking of websites on any particular search engine.
Here is the short description the reveals the difference:
Spider - a browser like program that downloads web pages.
Crawler - a program that automatically follows all of the links on each web page.
Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task. They can combine the tasks of crawler & spider together and help in indexing and ranking of websites on any particular search engine.
1000's of IT jobs in the UK online now at Dice
Grab a LIFETIME Discount off Elegant Themes
Grab a LIFETIME 40% Discount off The Best Spinner
Buy Ebooks for $6 per page!
Order 10 articles get One FREE