Membership is blocking access even when it is disabled

I am setting up a sandbox to test some functionality we may want for doing training. When I installed Membership, it immediately began blocking all public access, even though it is disabled. If I deactivate the plugin, the blocking stops (of course), but when activated it starts doing it again.

Any ideas? This is currently running on TwentyTwelve theme to minimize conflicts.