e-Mail remain the same

Dear,
I've noticed that if a member change his e-mail address, the former e-mail remain in the newsletter database. Is it normal? How to replace the former one by the new one?
Best regards