WP Defender Uninstall still gives 403 Forbidden error for Wp-Admin

Hi,
WP Defender wasn't working great with this website. I uninstalled WP Defender, but now I cannot login through /wp-admin due to 403 forbidden error keeps appearing. I have to keep adjusting the .htaccess file to get in the backend of WordPress. Can anyone help with this? Thank you.