Easy Blogging plugin - media insert button doesn't work

The media upload button is not working when I install Easy Blogging. I'm running WordPress 3.5.2 with the Starkers theme which is very bare bones.