Completely confused and looking for suggestions/answers?

I have a WP site which got hit by penguin/panda and never done anything about it, but a month or so back I decided to just get rid of the static home page and put my latest posts up instead, even though I haven't added any in ages, but here's the strange thing.

After changing things about I clicked the visit site link from the WP dashboard and opened in a new tab to check it was ok, which it was, but after giving it a few days and checking Googles cached version it kept showing the old page which also has the date on it and which was in May 2012. I checked a few times and every time the old homepage was shown, and although I did ask here before of any ideas with no responses I just left it as I just thought it was Googles way of saying FU, they were no longer going to cache the site.

So today as I was bored for a moment I search for the main keyword on Google, and when I see my site (on the last page) I just click the link and the old page is still showing, even though I deleted it ages ago. So this explains why the old page is always cahed. So now I just type the sites url straight into the address bar instead and the old page is still showing, yet if I visit the site from the WP admin page it shows the latest posts and not the old page.

Now I cleared the sites cache etc and my cookies blash blah blah and when I put the url in again it's the latest posts. I tried about 10 minutes later and it's the old page again? So if you're not confused by this possibly rather confusing thread has anybody any ideas?

Thanks.