Forminator – admin ajax

I am using Forminator with a cache plugin and it makes admin ajax load up to 2 secs.

If I disable either forminator or the caching plugin the admin ajax is gone, well not entirely gone but not close to 1sec load times, I have tried every combination possible!