WP Hummingbird breaking site

Hummingbird seems to be breaking my site. I've now deactivated it and my site is back to normal. However, I'd really like to use Hummingbird. Any advice on how to make it agree with my site?