Domain Mapping causing admin pages to load 10+ Seconds

Domain Mapping is causing my admin panel to load admin pages after waiting for 10+ Seconds.

The page will load after the 10+ seconds in under 2 seconds. All admin pages on all sites in the multisite are affected.

Please advise.