Web pages in Google that should not be there

11 replies
  • SEO
  • |
Hi all,

Have 2 pages that are showing up in Google that should not be there.

If one goes here: TinyURL.com - shorten that long URL into a tiny URL

At the bottom, there are 2 entries that should not be there

One is "August | 2014 ..."

The second is "Mike Jones ..."

** I have added the following to the robots.txt

#do NOT allow this site to be crawled AT ALL!
User-agent: *
Disallow: /

** I have also installed the SEO YOAST and configured it so that ALL items are "no index, follow"

** I also removed the indexing of the pages here:
https://www.google.com/webmasters/tools/removals

QUESTION 1: What I want is the site not to be indexed - at all - nothing, nada, zip, zilch - Is there anything else I can do? I remove the items from the Google cache but they still return?

I also looked at this page:
https://wordpress.org/support/topic/...-and-following
"you want the links on that page to pass the link value."

QUESTION 1: What does "you want the links on that page to pass the link value." mean?

Regards.
#google #pages #web
  • Profile picture of the author yukon
    Banned
    That main.domain.com page doesn't include a noindex in the HTML source code.

    Personally I would only use a noindex in the HTML of each individual webpage that I wanted removed from Google SERPs. Make it the first tag after the <head>.

    Example:

    Code:
    <head>
    <meta name="robots" content="noindex">
    {{ DiscussionBoard.errors[9893389].message }}
    • Profile picture of the author dgmufasa
      Thanks for the response.

      I want main.domain.com to remain.

      What I wanted to disappear was demo-estate.domain.com - this is just a demo page/site, so I did not want it to be in Google at all.

      It was for that reason I added

      #do NOT allow this site to be crawled AT ALL!
      User-agent: *
      Disallow: /
      to the robots.txt file under "demo-estate"
      {{ DiscussionBoard.errors[9893515].message }}
      • Profile picture of the author yukon
        Banned
        Originally Posted by dgmufasa View Post

        Thanks for the response.

        I want main.domain.com to remain.

        What I wanted to disappear was demo-estate.domain.com - this is just a demo page/site, so I did not want it to be in Google at all.

        It was for that reason I added



        to the robots.txt file under "demo-estate"
        The cache date is Jan 20, 2015 so apparently Google hasn't re-indexed the page yet. That specific page (demo-estate.domain.com) does include a noindex tag in the HTML.

        You need to get Googlebot back on that webpage before they'll remove it from the SERPs.

        Use Webmaster Tools Fetch as Google which will usually take only a minute or two to re-index the webpage or build temporary backlinks pointing to the page that includes the noindex tag. Either way Google has to return to the page before they'll remove the page from the SERPs.
        {{ DiscussionBoard.errors[9893571].message }}
        • Profile picture of the author dgmufasa
          Thanks guys for the info

          @Yukon
          I saw that the cached version did not have a "noindex".

          I executed the Google Fetch - so - I will be looking forward to this disappearing from the list of pages associated with the website

          The only thing that bugs me is that when executing the following for a google search
          Google Search Consulting

          sometimes advertisements appear on the right hand side and then hitting the link for "More results from domain.com", sometimes you see advertisements on the bottom.

          It would not be so bad were it not advertisements of perceived competitors.

          Finally with this part,

          I also looked at this page:
          https://wordpress.org/support/topic/...-and-following
          "you want the links on that page to pass the link value."

          QUESTION 1: What does "you want the links on that page to pass the link value." mean?
          I take it that "link value" = "link juice"?
          {{ DiscussionBoard.errors[9894970].message }}
  • In your real estate demo there is this code:
    <meta name="robots" content="noindex, follow">

    Try to change it to <meta name="robots" content="noindex, nofollow">

    By default Search engines will index and follow, so you only need to specify when you do not want they to do that.
    Signature
    YOUR FB ADS ACCOUNT WAS CLOSED? >>>>I GOT A SOLUTION<<<< CONTACT ME
    {{ DiscussionBoard.errors[9893578].message }}
    • Profile picture of the author yukon
      Banned
      Originally Posted by TopSocialMarketing View Post

      In your real estate demo there is this code:
      <meta name="robots" content="noindex, follow">

      Try to change it to <meta name="robots" content="noindex, nofollow">

      By default Search engines will index and follow, so you only need to specify when you do not want they to do that.
      A webpage can be noindexed & still allow links to be followed, so that's not stopping his page from being removed from the SERPs. Google just hasn't found the noindex yet.
      {{ DiscussionBoard.errors[9893591].message }}
      • Originally Posted by yukon View Post

        A webpage can be noindexed & still allow links to be followed, so that's not stopping his page from being removed from the SERPs. Google just hasn't found the noindex yet.
        It might be that. Certainly nobody can be 100% sure. So additional steps can benefit.
        Signature
        YOUR FB ADS ACCOUNT WAS CLOSED? >>>>I GOT A SOLUTION<<<< CONTACT ME
        {{ DiscussionBoard.errors[9893625].message }}
        • Profile picture of the author paulgl
          Much ado about nothing.
          What's the big deal?

          Just because you find it, in no way means anyone in their sane mind
          would ever find it. And if they did, who cares?

          If you really don't want it to be found online, then take the friggin thing
          offline. Simple. Or password protect it. Or any other logical idea.

          Google never guarantees that it will deindex anything, whether you like
          it or not. Too many intangibles.

          Deal with it the right way, or better still, forget it.

          Paul
          Signature

          If you were disappointed in your results today, lower your standards tomorrow.

          {{ DiscussionBoard.errors[9893699].message }}
          • Profile picture of the author yukon
            Banned
            Originally Posted by paulgl View Post

            Much ado about nothing.
            What's the big deal?

            Just because you find it, in no way means anyone in their sane mind
            would ever find it. And if they did, who cares?

            If you really don't want it to be found online, then take the friggin thing
            offline. Simple. Or password protect it. Or any other logical idea.

            Google never guarantees that it will deindex anything, whether you like
            it or not. Too many intangibles.

            Deal with it the right way, or better still, forget it.

            Paul
            OPs example page/URL is as simple as it gets for removing webpages.

            I guarantee Google will remove that webpage when they find the noindex tag.

            Look at the cache for OPs example page/URL, there's not a noindex tag in the cache HTML source code because it didn't exist until after Google visited the webpage.

            All OP has to do is get Google to return to the noindex webpage. Done deal.
            {{ DiscussionBoard.errors[9893740].message }}
        • Profile picture of the author yukon
          Banned
          Originally Posted by TopSocialMarketing View Post

          It might be that. Certainly nobody can be 100% sure. So additional steps can benefit.
          The page was last cached Jan 20, 2015. That tells me OP didn't add the noindex tag until at least after that cache date because Google will easily remove a webpage from the SERPs.
          {{ DiscussionBoard.errors[9893733].message }}
  • Profile picture of the author Markets
    These no index requests are simply requests, they do not have to be followed.

    What you could try is see if other search engines are indexing your web-page still, if they are, then it is most likely an issue on your end. If not, then it might have to do with Google.
    Signature
    "There comes a time when people get tired."
    {{ DiscussionBoard.errors[9893908].message }}

Trending Topics