Custom press public settings

I appear to be having an issue with Customer Press's public settings.

When I select 'Advanced' and check 'TRUE' for all the options that the Public 'TRUE' has, the permalinks don't work. I can still access a page via it's /post-type/post-1 url but not by ?p=1234.

Ultimately I want to have the post types public but I don't want them in the left hand nav of the wp admin, but I don't seem to be able to do both.