I am trying to find an older version of a website. Doing a search on waybackmachine.com says it is blocked by a robot.txt. The explaination says that there is no standard for the robot.txt and that other archive sites to do take any notice of them. What archive sites are these as I cannot find any? I am doing research on a site that is for sale and I want to see what was on it previously. I appreciate I can ask the seller (dealer) but he may only give me selective infomation.

Cheers