Need help with website URL

3 replies
  • SEO
  • |
Hi Everyone,

I have a question regarding a problem with e-commerce URL.

When a user enters a search query on the e-commerce website a custom URL is generated, this URL is been crawled by Google and shows in Google Webmaster tool as 'URL Not Found' or 'Unreachable'.

How can we prevent this URL's generated by search to reflect in webmaster tool as 'Not Found'. I can't keep on removing it every time and forever. I want a permanent solution that can prevent these URL from Google.

Looking forward for your answers!
#google #url #webmaster tool #website
  • Profile picture of the author simpleonline1234
    Have you checked to see whether or not your blocking the URL from being indexed?

    That may be why can't see the page.
    Signature
    Check out deals
    {{ DiscussionBoard.errors[4814833].message }}
  • Profile picture of the author PromoDirect
    I haven't blocked any URL so far. The URL extension for search is this ('www.myblog.com/search?updated-max=2009-08-04T00%3A03%3A00-07%3A00&max-results=5').

    Now seeing the URL extension what URL should I command to be blocked in search engine using Robots.txt?
    {{ DiscussionBoard.errors[4842803].message }}
  • Profile picture of the author cadmo
    [DELETED]
    {{ DiscussionBoard.errors[4844386].message }}
    • Profile picture of the author paulgl
      It would be something like this:

      User-agent: *
      Disallow: /search

      That would keep search results from being indexed.

      If your CMS was properly programmed, it would have
      done this automatically.

      In reality, any past ones indexed won't matter.

      Funny thing. People think
      User-agent: *
      Disallow: /search
      Means you are blocking search engines
      (you're not)

      You're site structure seems that search is indeed generated
      by domain.com/search

      Paul
      Signature

      If you were disappointed in your results today, lower your standards tomorrow.

      {{ DiscussionBoard.errors[4844485].message }}

Trending Topics