Membership Subscription not dropping after the upgrade

We have 4 different paid subscription level. Initially we are giving 3 month of free membership which is a different membership.

Once the user upgrades from Free Membership to other paid membership, the new membership is added but the Free membership is not dropped. So, after the upgrade he has 2 active membership while he should only have 1.