How do I uninstall a plugin when it has locked me out of my site completely?

"The Invite plugin is only compatible with WordPress Multisite."

This is the phrase that has taken over my entire site, and disallows me from reaching my WP-Admin page.

Must I manually remove the plugin? If so, how?