should I turn off plugins?

Does turning off some plugins offer any advantages?
I wonder if turning off plugins I am not using could be beneficial to my site behavior/performance. For example TinyMCE Advanced and Ping Optimizer are not necessary while I am not adding new content.
Thank you,