Remove an ip address from being locked out without whitelisting

Is it possible to remove an ip address from being temporarily locked out without adding it to the white list.
White listing an ip address doesn't guarantee that the ip will not be misused later. If a client locks themself out by accident, lets saying using a public wifi, I don't want to have to whiltelist a public wifi.
I just want to be able to log in, unblock them, and then go about my business.