Need help with website URL

PromoDirect · 10-05-2011, 07:27 AM

Hi Everyone,

I have a question regarding a problem with e-commerce URL.

When a user enters a search query on the e-commerce website a custom URL is generated, this URL is been crawled by Google and shows in Google Webmaster tool as 'URL Not Found' or 'Unreachable'.

How can we prevent this URL's generated by search to reflect in webmaster tool as 'Not Found'. I can't keep on removing it every time and forever. I want a permanent solution that can prevent these URL from Google.

Looking forward for your answers!

simpleonline1234 · 10-05-2011, 11:15 AM

Have you checked to see whether or not your blocking the URL from being indexed?

That may be why can't see the page.

PromoDirect · 10-10-2011, 04:26 AM

I haven't blocked any URL so far. The URL extension for search is this ('www.myblog.com/search?updated-max=2009-08-04T00%3A03%3A00-07%3A00&max-results=5').

Now seeing the URL extension what URL should I command to be blocked in search engine using Robots.txt?

paulgl · 10-10-2011, 10:19 AM

It would be something like this:

User-agent: *
Disallow: /search

That would keep search results from being indexed.

If your CMS was properly programmed, it would have
done this automatically.

In reality, any past ones indexed won't matter.

Funny thing. People think
User-agent: *
Disallow: /search
Means you are blocking search engines

(you're not)

You're site structure seems that search is indeed generated
by domain.com/search

Paul

10-05-2011, 07:27 AM	#1
PromoDirect HyperActive Warrior Join Date: Jan 2011 Posts: 179 Thanks: 0 Thanked 7 Times in 7 Posts	Need help with website URL Hi Everyone, I have a question regarding a problem with e-commerce URL. When a user enters a search query on the e-commerce website a custom URL is generated, this URL is been crawled by Google and shows in Google Webmaster tool as 'URL Not Found' or 'Unreachable'. How can we prevent this URL's generated by search to reflect in webmaster tool as 'Not Found'. I can't keep on removing it every time and forever. I want a permanent solution that can prevent these URL from Google. Looking forward for your answers!
	Promo Direct -- We bring more than 20 years of experience in the Promotional Products industry. Imprinted Promotional Calendars 2012 \| Custom Imprinted Promotional Bags \| Imprinted Personalized Promotional Pens

10-05-2011, 11:15 AM	#2
simpleonline1234 SEO Analyst War Room Member Join Date: Feb 2009 Posts: 458 Thanks: 0 Thanked 56 Times in 34 Posts	Re: Need help with website URL Have you checked to see whether or not your blocking the URL from being indexed? That may be why can't see the page.
	Dog Ramps for Cars

10-10-2011, 04:26 AM	#3
PromoDirect HyperActive Warrior Join Date: Jan 2011 Posts: 179 Thanks: 0 Thanked 7 Times in 7 Posts	Re: Need help with website URL I haven't blocked any URL so far. The URL extension for search is this ('www.myblog.com/search?updated-max=2009-08-04T00%3A03%3A00-07%3A00&max-results=5'). Now seeing the URL extension what URL should I command to be blocked in search engine using Robots.txt?
	Promo Direct -- We bring more than 20 years of experience in the Promotional Products industry. Imprinted Promotional Calendars 2012 \| Custom Imprinted Promotional Bags \| Imprinted Personalized Promotional Pens

10-10-2011, 10:19 AM	#4
paulgl Plundering the Web War Room Member Join Date: Feb 2007 Location: , , . Posts: 4,851 Thanks: 804 Thanked 1,200 Times in 887 Posts	Re: Need help with website URL It would be something like this: User-agent: * Disallow: /search That would keep search results from being indexed. If your CMS was properly programmed, it would have done this automatically. In reality, any past ones indexed won't matter. Funny thing. People think User-agent: * Disallow: /search Means you are blocking search engines (you're not) You're site structure seems that search is indeed generated by domain.com/search Paul
	How to Make Money off Facebook: Login to your account. Deactivate your account. Get your butt to work.