Best practice to activate plugin in network site

i have multiple sites in my network. I have been practicing to activate plugin across all sites. I noticed today that some sites are not using the activated plugin and does that slow down the site?

May i know the best practice and is there any plugin to manage which site will have a plugin activated instead of doing it one site at a time.