2 {{ upvoteCount | shortNum }}
2 {{ upvoteCount | shortNum }}

Robots.txt question

by pepes4329
2 replies
So I had a domain name that i no longer needed to use and I belive it was hurting my money site domain so I did a block url robots.txt and I submitted to google to block that url. I did that last night and now today it no longer shows up in the serps

I have another one and before I go ahead and do it I have a quick question

the domain I want to block google from crawling is a SUB DOMAIN

www.myweb.c*m/sub.html

sorta looks like that^^^

Will google block it or will it block the whole domain ?
#question #robotstxt
  • Profile picture of the author The Real Deal
    Originally Posted by pepes4329 View Post

    the domain I want to block google from crawling is a SUB DOMAIN

    www.myweb.c*m/sub.html

    sorta looks like that^^^

    Will google block it or will it block the whole domain ?
    That is not a sub domain, that is a page.

    To block that page you simply enter this as plain text in your robots.txt file:

    Code:
    User-agent: * 
Disallow: /sub.html
    (the * disallows all bots, or rather all bots that care about robots.txt I should say :rolleyes

    If you wanted to disallow a directory called /sub, you would do this:

    Code:
    User-agent: * 
Disallow: /sub/
    {{ DiscussionBoard.errors[6814764].message }}
  • Profile picture of the author pepes4329
    Thank You.........
    {{ DiscussionBoard.errors[6814927].message }}

Trending Topics