Membership Website with multiple levels

Ok I am almost done with my membership site but want to know how to tackle the plugins. How do you have them available to your members with having them all active and slowing down my site?
I guess a better way to ask the question is how do you setup all the plugins to be available to your members without having them all active on my main site are is that possible?