theme switcher appears in toolbar

The theme switcher is appearing in my admin bar across all sites. However, if I'm reading these instructions, it would seem that you have to add code to the config file first. Which I didn't do, so I'm confused as to how it's showing up.