![]() | | ||||||||
| | #1 |
| HyperActive Warrior Join Date: Jan 2012
Posts: 146
Thanks: 0
Thanked 4 Times in 4 Posts
|
How can a single bot crawl all the web pages in www? Do google.co.in, google.com.au, google.co.uk and etc have individual bots to crawl their region specific pages?
|
| | |
| | |
| | #2 |
| Advanced Warrior Join Date: May 2011 Location: London
Posts: 708
Thanks: 8
Thanked 56 Times in 55 Posts
|
there are more than anybody can count. Why would you think there is only 1 or 1 per region?
|
|
Find permanent and contract IT Jobs in Europe 1000's of IT Contract Jobs in the UK live now To search 10000's of IT Jobs in the UK click here | |
| | |
| | #3 |
| HyperActive Warrior Join Date: Jan 2012
Posts: 144
Thanks: 1
Thanked 6 Times in 6 Posts
|
Matt was recently asked how many bots/spiders does Google currently have to crawl the web. He didn't give an exact answer but less than 1000 computers are deployed at various Google datacenters with the purpose of indexing the web.
|
| | |
| | |
| | #4 |
| Active Warrior Join Date: Jun 2011
Posts: 51
Thanks: 0
Thanked 0 Times in 0 Posts
|
The simple answer is well..A LOT.
|
| | |
![]() |
|
| Tags |
| bots, google |
| Thread Tools | |
| |
![]() |