My first step was to take down the automated backlinks that I was subscribed to.
My second step was to hire a company to manually create creditworthy backlinks, press releases etc
My third step, and believe it or not this is what I think solved my issues, was to change my SEO plugin - so simple!
My message to everyone is DO NOT GIVE UP. My site is now seeing more than 1000 visitors a day.