Media Protection in Membership 2 slows down the site and CPU spikes up

Enabling media protection in Membership 2 spikes CPU up to 99%. Disabling it takes it down to ~20%. It slows down the site as well to a huge extent. We have 20000 users on the site and 342,000 usermeta rows. We've tried enabling debug but couldn't find anything relevant there. Deactivating other plugins did help a bit but the main concern is the Media Protection add-on.