When to use mu-plugins vs. plugins folder

I am confused about the mu-plugins folder. My WP multisite install doesn't have it. Do I need to create it or is it okay just to put all plugins in the regular folder? If I need to create it then also how do I distinguish when I should use the mu-plugins folder vs. when I should use the regular plugins folder?