Can I delete the default Wordpress Theme?

Is it ok to delete the Twenty Twelve theme that comes shipped with Wordpress?