admin-ajax.php high load on server

/wp-admin/admin-ajax.php Keeps getting called from what i guess visitors logging into site. Is there anyway to limit or stop this call ? since its creating a large load on my server and slowing all sites on it.