Will deactivated plugins slow down my site?

On a parallel thread I asked about speeding up my site. I'm wondering if I try out plugins and deactivate them, will it goober up my database or code and slow my site down, or should I delete them completely?