Media settings: are we forced to have 4 sizes?

Hi,

My question is about media settings:
are we forced to have 4 sizes (original, thumbnail, medium, large)?

I'm asking this because on one of my sites there is a LOT of images and I suspect some sizes not being used (so I could shrink the total size of this site on my server).

Thanks!
Best Regards