Limit Plugins?

I have a blog network with paid subscribers. The only complaint I have received is that users want plugins that I don’t offer and they have no way to upload their own set of plugins.

I have many WPMUDev plugins available for users because they are supported. But I’m wondering if there is a disadvantage to uploading lots of plugins to the network? (The same question could apply to themes.)

I realize that ACTIVATING lots of plugins will slow sites down (individual or entire network?), but would uploading many be a problem so that each user can have the ones they’d like?