Hummingbird Slows Down My Site

Hello, having a hard time setting up Hummingbird, can only seem to make it slow down my site lol. So far all I've done is enable gzip compression and let it combine and minify files at it sees fit. Google Pagespeed Insights shows scores 5-6 points lower when Hummingbird is active vs inactive.

I can't see why compressing and combining files can make a site slower. Has this happened before? Is there any documentation that might be able to help?

In a related issue, I originally downloaded this plugin to defer a couple of js files that are slowing down my site. I don't see them on Hummingbird's list of files available for defering. Is it still possible to defer these files with Hummingbird?