can you do a no follow of content?

4 replies
  • SEO
  • |
Can you program a "no follow" of SOME of the content on a page and leave other content on the page exposed to crawlers and search engine indexing?
#content #follow
  • Profile picture of the author theturd
    yeah the second part is what i am asking about
    on a page can you designate a certain section to no be crawled
    and in the robots.txt file can you designate a certain pages on your site to not be crawled or just a folder?
    Signature
    ★★★★★ My Buddy, Your Buddy, TWEET BUDDY! ★★★★★

    {{ DiscussionBoard.errors[2305577].message }}
  • Profile picture of the author CliveG
    Yes you can, at least with Google. I can't remember exactly how but there are instructions on the Google website.
    {{ DiscussionBoard.errors[2307097].message }}
  • Profile picture of the author CliveG
    Sorry, ignore that - was thinking of section targetting for Adsense.
    {{ DiscussionBoard.errors[2307102].message }}
  • Profile picture of the author AndyBeard
    Yahoo has robots-nocontent but last I heard Google isn't planning to adopt it, partially because webmasters in general haven't use the Yahoo tag.

    For Yahoo you would implement it like this

    HTML Code:
    <ul class="robots-nocontent">
        <li>class="this-is-what-the-user-really-sees"</li>
        <li>class="this-is-my-ripped-off-content"</li>
        <li>class="these-are-my-p0rn-ads"</li>
        <li>class="I-am-not-a-thin-affiliate-really"</li>
    </ul>
    The closest you can get with Google?

    Use javascript and have the external javascript code blocked by robots.txt
    If you are using AJAX, then have the loaded code blocked with robots.txt
    Use images... despite rumors Google isn't doing OCR on the whole internet
    Use flash and have it blocked, or loading dynamic content that is blocked.
    {{ DiscussionBoard.errors[2307126].message }}

Trending Topics