Enabling SSL on Primary site ONLY in Multisite

I have a quick question that I can't seem to fix myself.

We have a network running on a multisite install using subdomains for the sub sites, we have SSL installed on the primary site but all dashboard links to the sub sites automatically add https to the links when they don't have or need SSL.