The thing that takes the longest is the "wait" time (the yellow line when doing a pingdom test). This wait time is usually between 2-5 seconds.
When doing a page speed test on Google, it says "Very slow server response time".
So all in all, does this have to do with my webhost?
I use citynetworkhosting.com and the server is located in Sweden. Most of my customers are located in the US.