Robot.txt files and a competitor?
Hoping to get some input...I am analyzing 2 websites; one is my client (who is getting beat) and the other is their main competition. My clients site has like 20 disallow's in the robot file...while their competitor has zero. My question is, are these affecting the PR in anyway? (I know it could be a million other things, but this is a big thing we noticed)
Thanks
meh