4 {{ upvoteCount | shortNum }}
4 {{ upvoteCount | shortNum }}

Can Somebody Please Explain What "Search Engine Robots" is All About?

by jonat2005
3 replies
I came to learn little about 'search engine robots' while undergoing an intense study of Adsense for Domain. But i want to understand properly what 'Search Engine Robots' are and their functions. Please help. Thanks
#explain #search engine robots
  • Profile picture of the author parbat
    Search engine robots are for to crawl your site and index them into search engine listings so that your site can appear in search engine results.

    whenever you submit your website url to search engine webmaster tools of google , yahoo or bing , they will provide you one robot.txt file , you can allow or disallow search engine robots by editing this robot.txt file.

    such a robots went from one page to other page and crawl the pages.
    {{ DiscussionBoard.errors[3482175].message }}
  • Profile picture of the author Ben Holmes
    Better known as 'spiders' - and as Parbat said, they crawl the web and index websites into their respective search engine.

    When I hear the word "robot", I think more in terms of your 'robot.txt' file - and rather than detail it here, anyone who wants more information on the robot.txt file is invited to simply Google that term - there's a tremendous amount of really good material already out there on the topic.

    And done far better than I'd be able to do here...
    Signature

    {{ DiscussionBoard.errors[3482188].message }}

Trending Topics