Membership caching issue

I have 2 memberships. When on the "Members" page inside the Membership 2 plugin it shows both memberships listed for all the users. However, not all users should have both membership types.
When I click on subscription details for a user that only has one membership, it looks correct on that page.
It becomes confusing and harder to manage when looking at the all members page and you see people with both memberships list

After deactivation "Speed up results" option in Membership 2 Settings, everything works fine.