| | ||||||||
| |||||||||
 |
02-12-2011, 12:05 AM
| #1 |
| kanhaiya Join Date: Feb 2011
Posts: 1
Thanks: 0
Thanked 0 Times in 0 Posts
|  robot dot txt
what is robot.txt file and why it is used.?
|
| | |
|  |
|
02-12-2011, 12:10 AM
| #2 |
| Active Warrior  Join Date: Jan 2011 Location: Melbourne
Posts: 50
Thanks: 0
Thanked 2 Times in 2 Posts
| Re: robot dot txt
You can block search engine or (Disallow search engines) to do not index your specified website page or content.
|
| Link Removed | |
|
| |
|
02-12-2011, 12:27 AM
| #3 | |
| Warrior Member Join Date: Jan 2011
Posts: 17
Thanks: 1
Thanked 0 Times in 0 Posts
| Re: robot dot txt Quote:
| |
|
| |
|
02-12-2011, 12:29 AM
| #4 |
| HyperActive Warrior Join Date: Sep 2010 Location: www.ayushiinfotech.com
Posts: 161
Thanks: 5
Thanked 2 Times in 2 Posts
| Re: robot dot txt
using robot.txt we must allow or disallow our web pages to search engines ex:login page, administrator page etc  |
| | |
|
| |
 |
|
| Tags |
| dot, robot, txt |
| Thread Tools | |
| |
 |
