| | ||||||||
| |||||||||
 |
11-06-2011, 08:50 PM
| #1 |
| HyperActive Warrior Join Date: Jan 2011 Location: Sydney
Posts: 205
Thanks: 20
Thanked 8 Times in 8 Posts
|  How to not crawl or index a page in Google.?
Hi, I don't want to index or crawl a particular page of my website in Google search engine. What i have to do for that. Please suggest me some URL or code so that it may help me.. Thanks |
| | |
|  |
|
11-06-2011, 09:02 PM
| #2 |
| HyperActive Warrior War Room Member  Join Date: Oct 2010
Posts: 324
Thanks: 1
Thanked 40 Times in 36 Posts
| Re: How to not crawl or index a page in Google.?
Everything you need to know (read it carefully): Block or remove pages using a robots.txt file - Webmaster Tools Help |
| ***************************************** Schedule Unlimited ScrapeBox Tasks! ***************************************** | |
|
| |
|
11-06-2011, 09:12 PM
| #3 |
| Plundering the Web War Room Member  Join Date: Feb 2007 Location: , , .
Posts: 4,851
Thanks: 804
Thanked 1,200 Times in 887 Posts
| Re: How to not crawl or index a page in Google.?
The only sure 100% way is to put them behind a password. If you've already put them on the web, you may be too late. Remember, google is not the only thing that crawls and indexes stuff. Google may find it, one way or the other, off these secondary and even tertiary sites. If it's on the web, it can be found. Don't put anything on your site that you really don't want google or anyone else to see without password protecting the page. Very easy, just create a subfolder and password protect that. Then anything in that folder is not ever seen by anyone. Paul |
| How to Make Money off Facebook: Login to your account. Deactivate your account. Get your butt to work.
| |
| |
|
11-06-2011, 09:37 PM
| #4 |
| Active Warrior Join Date: Nov 2011
Posts: 65
Thanks: 2
Thanked 4 Times in 4 Posts
| Re: How to not crawl or index a page in Google.?
robot.txt helps to not crawl a particular page. For example: User-agent: * Disallow: /yourperticularpagename/ |
| | |
|
| |
|
11-06-2011, 09:37 PM
| #5 | |
| HyperActive Warrior Join Date: Jan 2011 Location: Sydney
Posts: 205
Thanks: 20
Thanked 8 Times in 8 Posts
| Re: How to not crawl or index a page in Google.? Quote:
I just want Google to not indexing a particular page. Can you suggest me the code.? | |
| | ||
|
| |
|
11-06-2011, 09:39 PM
| #6 | |
| Active Warrior Join Date: Nov 2011
Posts: 65
Thanks: 2
Thanked 4 Times in 4 Posts
| Re: How to not crawl or index a page in Google.? Quote:
User-Agent: Googlebot Disallow: /youtperticularpagename/ | |
| | ||
|
| |
|
11-07-2011, 03:15 AM
| #8 |
| Active Warrior  Join Date: Aug 2010 Location: Nashua
Posts: 91
Thanks: 0
Thanked 5 Times in 5 Posts
| Re: How to not crawl or index a page in Google.?
you can use robot.txt file for not crawl by Google on a particular page
|
| | |
|
| |
|
11-07-2011, 04:08 AM
| #9 | |
| HyperActive Warrior  Join Date: Aug 2011
Posts: 145
Thanks: 15
Thanked 10 Times in 10 Posts
| Re: How to not crawl or index a page in Google.? Quote:
HTML Code: User-agent: *
Disallow: /<your-folder-to-hide-from-searchengines> | |
|
Amazing things waiting on your Cyprus Holidays | ||
|
| |
 |
|
| Tags |
| crawl, google, index, page |
| Thread Tools | |
| |
 |
