10 {{ upvoteCount | shortNum }}
10 {{ upvoteCount | shortNum }}

How to Stop Google Crawling a Certain Section of My Pages?

by joecool1972
7 replies
Hi all,

I was wondering if there was a code for stopping google from crawling a certain portion of my web pages.

Bascially, I want to have about 100 - 150 words at the bottom of each one of my pages which will essentially say the same thing. Hence it will be duplicate content of a few paragraphs that span across all my pages (and I have loads of pages).

I was wondering if there was away to stop google from looking at this specific content on each page i.e. some sort of " html code" that I could wrap around the content that says, "Don't bother reading this".

The content is purely for my visitors and I don't need or want to gain any sort of google exposure for it.

I know all about the "noindex" etc for whole pages but I have been searching and can't find anything about a code for a section of a page. I don't want this duplicate content across all of my pages, since I am a bit concerned about been penalised in someway because of it (don't know if I will, but better to be safe than sorry, especially as my website gets thousands of visitors a month and high rankings, I don't want to risk anything.)

Help...

Any advice would be gratefully received.
#crawling #google #pages #section #stop
  • Profile picture of the author NadBedar
    Hi,

    Once I was looking for the same codes but I could not find anything.

    If you find any further information, please update me as well.

    Thanks

    Nad
    {{ DiscussionBoard.errors[2225627].message }}
    • Profile picture of the author bluegold14
      Directly from Google:

      "Well - you have 2 potential options.
      You can use JavaScript, or you can use Frames.

      JavaScript.
      Google tends to ignore most JavaScript.
      That means you could load up the content you want hidden/ignored/discounted in JS.
      The problem is - Google "may" still understand it/read it/reference it.
      The only really safe way is to include the content in an external JS file, and block that file in robots.txt.
      (Alternatively - you could use the x-ref header of NoIndex for .JS files etc.)
      Otherwise - if you have the JS in your file, as inline/embedded content - it may still be used (unlikely, but possible).

      Frames
      You could place the content you want hidden/ignored/discounted in a separate file.
      You set the robot-meta for that file as NoIndex (or you could block it with robots.txt or use the x-ref header of NoIndex).
      You then load that content into your page using a Frame.
      Google will crawl your page, see the frame, look to the framed file - se it is blocked (noindex/disallowed),
      and not touch it."

      Source:How to stop part of page being indexed // Tell Google not to index some content ::: Auto-Response ::: - Webmaster Central Help
      {{ DiscussionBoard.errors[2225681].message }}
  • Profile picture of the author Regional Warrior
    Originally Posted by joecool1972 View Post

    Hi all,

    I was wondering if there was a code for stopping google from crawling a certain portion of my web pages.

    Bascially, I want to have about 100 - 150 words at the bottom of each one of my pages which will essentially say the same thing. Hence it will be duplicate content of a few paragraphs that span across all my pages (and I have loads of pages).

    I was wondering if there was away to stop google from looking at this specific content on each page i.e. some sort of " html code" that I could wrap around the content that says, "Don't bother reading this".

    The content is purely for my visitors and I don't need or want to gain any sort of google exposure for it.

    I know all about the "noindex" etc for whole pages but I have been searching and can't find anything about a code for a section of a page. I don't want this duplicate content across all of my pages, since I am a bit concerned about been penalised in someway because of it (don't know if I will, but better to be safe than sorry, especially as my website gets thousands of visitors a month and high rankings, I don't want to risk anything.)

    Help...

    Any advice would be gratefully received.
    JC try here they may have the answer
    {{ DiscussionBoard.errors[2225682].message }}
  • Profile picture of the author GuerrillaIM
    Make the text appear in an image and then set the image folder to be dissalowed in the robots.txt file.
    {{ DiscussionBoard.errors[2226052].message }}
    • Profile picture of the author -Jericho-
      Originally Posted by GuerrillaIM View Post

      Make the text appear in an image and then set the image folder to be dissalowed in the robots.txt file.
      This was what I was going to say but minus the robots.txt part. Make it an image of text that matches and optimize the image for better SEO of the site. Disallowing it in robots.txt I think is overkill.
      Signature

      {{ DiscussionBoard.errors[2226149].message }}
  • Profile picture of the author GuerrillaIM
    Actually, better idea might be to use an Iframe and dissalow the page loaded in the iframe.
    {{ DiscussionBoard.errors[2226869].message }}
    • Profile picture of the author joecool1972
      Thanks for a the help everone. I first thought was to make it into an image, as has been suggested, however, I was struggling to make the image good enough to look like text, but I am sure I can. I didn't plan on doing the whole Robot.txt. thing because I think, as someone else mentioned, that may be a bit of overkill.

      I don't really want to go down the "frames" or "Javascript" route if I can help it.

      Anyway, thanks everyone.
      {{ DiscussionBoard.errors[2231210].message }}

Trending Topics