Garbage/Spam Links to my site..

Weird scenario. Bought a domain a few days ago. Never really thought to check it's history or anything. Anyway, been building the site up.. and randomly decided to check it's alexa score (even thought I knew it would be zero), I did it anyway.

..Low and behold, there are 12 sites linking to it. I check it out, and it appears it was owned by someone back in 2011 who attempted to spam their link on various sites and blogs.

I checked a lot of these sites and they have really poor reputation as well. A few of them are indian websites (which are a joke %90 of the time), and from various countries, and just look like crap.

I'm starting to worry that this might hurt me later on. I realize this is just alexa.. but wondering if google has a history report of this domain and has already considered it as "spam".

I just don't want the previous owner to slam my reputation, because I plan to grow this domain the right way and profit from it, the white hat way.

I just added the website to my webmaster tools as well. Is that enough to tell me what to fix?

What do you guys think? Am I trippin' over nothing?