Number of plugins. When is too many?

I was installing many of the plugins. So many sound so good. Got me to wondering about having too many installed and running.

How many is too many?

What happens to network or a site, when using lots of plugins?

Thanks,
Tom