Hummingbird is conflicting with cache plugin and breaking sites

Whenever we install Hummingbird and a caching plugin (like Comet Cache) elements like a slider or blog grid break randomly. If we clear the cache of the site it returns to normal for one or two days, and then breaks again. We've tried WP Fastest Cache, Super cache and a few other plugins. Same problem every time.