A question about robots.txt

tonywarrior2 · 11-03-2010, 06:23 AM

Hi folks

a client has a site with product images. When you click on a product image, a pop-up page with a larger image is displayed. The problem is that Google has started indexing these pop-up pages but the client doesn't want them in the SERPs. Can I put every one of those product pop-up pages into the robots.txt file?

The url is in this format: www.mysite.com/image.php?id=217

Thanks!

yanivkalfa · 11-03-2010, 07:02 AM

You can and you can also use No index.

Now if these pop-up page - are actual page using a bot wont be a problem by actual page i mean they have their own url.
though if they pop(with jave scrip or CSS or Jquery) and they dont have their own url bot file wont help you and you'll have to use No index.

tonywarrior2 · 11-03-2010, 07:22 AM

Thanks.

Here's a Matt Cutts video

that explains about them both

.

yanivkalfa · 11-03-2010, 07:32 AM

There you go then - problem solved :_)

tonywarrior2 · 11-03-2010, 08:07 AM

not quite ...

the format of the URL is: www.mysite.com/image.php? and the ID gets added when the visitor clicks the image. If the noindex is added to www.mysite.com/image.php? will this stop all the pages with 'id=xxx' being indexed?

Tony

Wesley Atkins · 11-03-2010, 08:13 AM

Yes, if you add a "NOINDEX" tag on this page...

image.php

..then all pages with the ID will not be included in the index..

I'm guessing that they have the smaller images in the same ID string, judging by your question, but this will not remove the page of content the image is sitting on..

..just all the image URL's from Google.. Which is what they want right??

Bit confusing, I know.. If you need help, send me a PM and I'll be only to glad to help you out..

yanivkalfa · 11-03-2010, 08:13 AM

It i thinks it should mate.

paulgl · 11-03-2010, 11:06 AM

I think people have a lame view of what google cares about showing in any
SERPs. Or maybe they think that their stuff is so important, google will show
it.

Google is smarter than that. Google is not in the habit of showing "pages"
like that in SERPs.

Tell them to relax and enjoy the ride.

If it's on the web, there's no guarantee google will not index it. But indexing
and showing are two completely different things. I am 99.999999% they would
never show the individual pop pages by themselves for any normal search.

Paul

11-03-2010, 06:23 AM	#1
tonywarrior2 ~~ Fire-Ready-Aim ~~ War Room Member Join Date: Dec 2008 Location: Europe Posts: 123 Thanks: 6 Thanked 7 Times in 6 Posts	A question about robots.txt Hi folks a client has a site with product images. When you click on a product image, a pop-up page with a larger image is displayed. The problem is that Google has started indexing these pop-up pages but the client doesn't want them in the SERPs. Can I put every one of those product pop-up pages into the robots.txt file? The url is in this format: www.mysite.com/image.php?id=217 Thanks!
	Me playing slow finger picking blues pretty badly!

11-03-2010, 07:02 AM	#2
yanivkalfa Back Link lover War Room Member Join Date: Aug 2010 Posts: 273 Thanks: 6 Thanked 45 Times in 13 Posts Social Networking Contact Info	Re: A question about robots.txt You can and you can also use No index. Now if these pop-up page - are actual page using a bot wont be a problem by actual page i mean they have their own url. though if they pop(with jave scrip or CSS or Jquery) and they dont have their own url bot file wont help you and you'll have to use No index.

11-03-2010, 07:32 AM	#4
yanivkalfa Back Link lover War Room Member Join Date: Aug 2010 Posts: 273 Thanks: 6 Thanked 45 Times in 13 Posts Social Networking Contact Info	Re: A question about robots.txt There you go then - problem solved :_)

11-03-2010, 08:07 AM	#5
tonywarrior2 ~~ Fire-Ready-Aim ~~ War Room Member Join Date: Dec 2008 Location: Europe Posts: 123 Thanks: 6 Thanked 7 Times in 6 Posts	Re: A question about robots.txt not quite ... the format of the URL is: www.mysite.com/image.php? and the ID gets added when the visitor clicks the image. If the noindex is added to www.mysite.com/image.php? will this stop all the pages with 'id=xxx' being indexed? Tony
	Me playing slow finger picking blues pretty badly!

11-03-2010, 08:13 AM	#6
Wesley Atkins SEO & IM Consultant War Room Member Join Date: Aug 2004 Location: London Posts: 217 Thanks: 21 Thanked 202 Times in 41 Posts Social Networking Contact Info	Re: A question about robots.txt Yes, if you add a "NOINDEX" tag on this page... image.php ..then all pages with the ID will not be included in the index.. I'm guessing that they have the smaller images in the same ID string, judging by your question, but this will not remove the page of content the image is sitting on.. ..just all the image URL's from Google.. Which is what they want right?? Bit confusing, I know.. If you need help, send me a PM and I'll be only to glad to help you out..
	===> FREE Report: Turn Your Passion Into A Profitable Online Business In 30 Days <===

11-03-2010, 08:13 AM	#7
yanivkalfa Back Link lover War Room Member Join Date: Aug 2010 Posts: 273 Thanks: 6 Thanked 45 Times in 13 Posts Social Networking Contact Info	Re: A question about robots.txt It i thinks it should mate.

11-03-2010, 11:06 AM	#8
paulgl Plundering the Web War Room Member Join Date: Feb 2007 Location: , , . Posts: 4,849 Thanks: 804 Thanked 1,199 Times in 886 Posts	Re: A question about robots.txt I think people have a lame view of what google cares about showing in any SERPs. Or maybe they think that their stuff is so important, google will show it. Google is smarter than that. Google is not in the habit of showing "pages" like that in SERPs. Tell them to relax and enjoy the ride. If it's on the web, there's no guarantee google will not index it. But indexing and showing are two completely different things. I am 99.999999% they would never show the individual pop pages by themselves for any normal search. Paul
	How to Make Money off Facebook: Login to your account. Deactivate your account. Get your butt to work.