issue with viewing site. "Authorization required - this blog may only"

After changing the network settings from "Allow admin only" to "allow all visitors to all site" i still can not log out and see my site as a visitor. I've cleared history and checked other issues. I now believe its just the "Multisite Privacy" plugin.