Defender having trouble loading up audit logs

When I try to view an audit log I get a message saying - "Whoops, Defender had trouble loading up your event log". This only happens when trying to load the logs for anything more than 4 days. The amount of logs doesn't seem to be very high and I have sites with more logs which load fine compared to the one in question. I've tried increasing memory_limit and max_execution_time, did conflict test and none of them helped. There are no errors in console and nothing relevant in debug.log