Option to remove Activate Easy Mode Button on Admin Bar?

Is there an option to remove the button on the Navbar for people not in Easy Mode? I do not see it in the settings...