Remove "Attending" RSVP button?

I have people complaining about needing to sign up in order to RSVP to an event. How do I remove all RSVP functionality?

Note: I activated the "Public Announcement Events" extra and checked off the "Public Announcement" box when I created the event. I'm still getting the RSVP "I'm Attending" button, though.