Pages get indexed that I do not want to have indexed!

by Roan
11 replies
  • WEB DESIGN
  • |
As the titles says it all. Some of my pages of a website get indexed that I do not want to have indexed. I hope someone can help me out here. Because now when someone types in this keyword they get access to certain data, I do not want them to get access to.

Whole the wp-content/uploads/ is visible. How can I change this?
#indexed #pages
  • Profile picture of the author xRaiser
    I hope you are using any SEO plugin with wordpress. You can mark them with noindex using SEO plugin ex. Yoast SEO
    {{ DiscussionBoard.errors[5434703].message }}
  • Profile picture of the author xtrapunch
    You can use a robots.txt file. You can start by copying my robots.txt here: speckygeek.com/robots.txt

    Upload the file to your main WordPress folder.
    Signature
    >> Web Design, Wordpress & SEO - XtraPunch.com <<
    Web Design & SEO Agency | Serving World Wide from New Delhi, India

    {{ DiscussionBoard.errors[5435043].message }}
    • Profile picture of the author marinelife
      I usually use the robots.txt file, this seems to be the best. I have seen people starting to add this feature in the SEO plugins.
      {{ DiscussionBoard.errors[5435398].message }}
  • Profile picture of the author sandebdavid
    Hey this should help you understand more How To Prevent Pages Being Indexed | New Webmasters
    Signature
    "For everyone somewhere there is a piece of heaven on earth"
    {{ DiscussionBoard.errors[5435554].message }}
  • Profile picture of the author iBBnet
    I used a robots.txt file on my sites. They work pretty good...
    Signature
    Bryan
    After5PC.net
    Freelance Web Development
    and Graphic Design Services
    {{ DiscussionBoard.errors[5435898].message }}
  • Profile picture of the author frenchsquared
    this is easier:
    <meta name='robots' content='noindex,nofollow' />

    add that to the head section of the pages you do not want indexed.

    Is /uploads/ a directory?
    if so make a file called index.html and place it in that directory.
    This will stop the list of files from showing.
    {{ DiscussionBoard.errors[5436008].message }}
  • Profile picture of the author Absolute Logo
    Use robots.txt you will be able to now have it crawled.
    Signature
    Absolute Logo Perfect for your small business!
    {{ DiscussionBoard.errors[5436594].message }}
  • Profile picture of the author kokopelli
    To prevent indexing/viewing, I create and upload a .htaccess file with the following to all my main WordPress wp- folders:
    Options All -Indexes
    Of course, you can also add it once to the main .htaccess file if you prefer ...

    IMHO this method is better than placing a blank index.html in a directory (e.g. wp-content), since the latter will only prevent someone from viewing the content in that directory (e.g. wp-content), but not the contents of sub-directories (e.g. wp-content/uploads). A .htaccess file, on the other hand, "propagates" to all sub-directories under it.
    Signature
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    {{ DiscussionBoard.errors[5437860].message }}
  • Profile picture of the author kl2000
    robots.txt is the way to go. Google webmaster tools has tools for removing a url, testing your robots.txt and generating robots.txt

    Just google "webmaster tools".
    {{ DiscussionBoard.errors[5457568].message }}
  • Profile picture of the author ritchierich
    Agree with everyone... robots.txt file. If you're running wordpress, install Wordpress SEO by Yoast.
    {{ DiscussionBoard.errors[5457883].message }}
  • Profile picture of the author gomzydecor
    Robots.txt files inform search engine spiders how to interact with indexing your content. y default search engines are greedy. They want to index as much high quality information as they can, and they will assume that they can crawl everything unless you tell them otherwise. If you specify data for all bots (*) and data for a specific bot (like GoogleBot) then the specific bot commands will be followed while that engine ignores the global/default bot commands.
    {{ DiscussionBoard.errors[5462575].message }}

Trending Topics