Site slapped AGAIN

I have a site that was ranked first page for tons of keywords yesterday, and today is on page 5 for some keywords and 10+ for most.


Since this is not the 1st site that has done this, I noticed a trend and have to ask if anybody else sees anything similar, or their own trends.


So whenever this happens, it's ALWAYS ALWAYS ALWAYS the day after I get the most visitors to the site.


Always!


I rank up...the site climbs...I get more and more visitors and everything looks great. Then one day I get more visitors than any other day.


And the next day the site is gone.


I'm not making this up, it's happened a solid 10 times now.


Things this site is NOT, or is not doing doing:

The google dance - I already went through the dance when the site was new. I ranked 1st page in 1 day actually, and after about 3 weeks (right around when Google started de-valuing links due to blog networks..or whatever the hell they did) the site disappeared from the map.


After about 2 months it came back, and has been climbing ever since.


I haven't built links to the site since then....not a single one. So to say that I have unnatural links or whatever and that's why it took a dive yesterday would mean you have to understand that those same links brought the site back from the depths of hell in the first place.


And I really don't believe that my lack of link building has anything to do with it. I test out "non competitive" keywords a LOT, and the ones that I rank for don't even require links most times.


I'm talking about keywords that are so untapped that a post on a posterous blog ranks 1st page in 5 minutes.


I've made post after post on this site and the keywords rank very highly without ANY link building...and not for a day or two....it's been months for some of my carefully keyworded posts.


I understand how links work, but I am in very low competition zones here.....or zero competition zones.


It also means that it survived Penguin and actually ranked UP during that time.


Competition:

I don't target keywords that everybody else does. I find untapped keywords that rank insanely fast....therefore I often have zero competition for my keywords, so I didn't just get a 10+ page bump from someone else.


I don't know what else it could be but I'm bored with Google. My bounce rate on the site is around 40% which I don't care what anybody says...that's not terrible!


My page views are 2.9 or so, so people are staying around the site for a while before leaving....so it's actually a "useful" site for people. Not an authority, but not a niche site with 2 pages.


Anyway......whatevs.


My question is still...have you guys noticed any kind of pattern like mine? Like for me, when I get a lot of traffic in one day, I know my site is fu*&ing doomed the next?


I won't be shocked if it's just me....that is the luck I've had since birth, but it's ridiculous at this point.


Thanks