improving server load time

I just finished running my hummingbird first report and the site got a 32 out of 100 on server response time and recommended that I get a full page caching plugin. I've heard mixed reviews of caching plugins. Which one do you recommend that is the least problematic?