8 {{ upvoteCount | shortNum }}
8 {{ upvoteCount | shortNum }}

Quick Reply need about Robots.txt file

by asghar
7 replies
  • SEO
    • |
Which is the better way to restrict Search Engines to index my Directory: "uploads" and the content in it?

User-agent: *
1: Disallow: /httpdocs/php/uploads/

2: User-agent: *
Disallow: /php/uploads/

3: User-agent: *
Disallow: /uploads/

if I use /php/uploads/ will search engines not index my "PHP" Directory?
#file #quick #reply #robotstxt
  • Profile picture of the author asghar
    Also,
    can I hide robots.txt file from visitors like if someone open the link "/httpdocs/robots.txt" but I dont want to show that which directory is most important but Search Engines can still read this robots txt file, is there any way?
    {{ DiscussionBoard.errors[2719426].message }}
    • Profile picture of the author emmamartin123
      I am looking for same stuff now a days if any have more idea about this then please mention here I am eagerly waiting for this .
      {{ DiscussionBoard.errors[2719458].message }}
  • Profile picture of the author Maheshpandit
    They will index. You have to restrict for php folder too..
    {{ DiscussionBoard.errors[2719524].message }}
  • Profile picture of the author bigcat1967
    Agree w/ the comment above - they should index, so you will have to restrict bots from indexing them.

    I believe the first one should work:

    User-agent: *
    Disallow: /httpdocs/php/uploads/
    Signature

    <a href="https://changeyourbudget.com/save-money-on-your-water-bill/">How to Lower Your Water Bill</a>

    {{ DiscussionBoard.errors[2719683].message }}
  • Profile picture of the author leapharris
    Google will index robots.txt and sitemap files first so there is no way to hide these files from Google and the format for not crawling that 'upload' folder is

    Useragent : Google
    Disallow : /uploads
    {{ DiscussionBoard.errors[2719761].message }}
    • Profile picture of the author paulgl
      Put your uploads in a password protected folder.

      Google is not the only one indexing stuff...

      Paul
      Signature

      If you were disappointed in your results today, lower your standards tomorrow.

      {{ DiscussionBoard.errors[2720296].message }}
      • Profile picture of the author asghar
        Originally Posted by paulgl View Post

        Put your uploads in a password protected folder.

        Google is not the only one indexing stuff...

        Paul
        that looks like a decent answer, I will have to try this one and I will let you know the results

        Thanks buddy
        {{ DiscussionBoard.errors[2720367].message }}

Trending Topics