"Hide Out of Stock Products" not hiding any items

Hi all,

Checking the option "Hide Out of Stock Products" does not seem to hide products that are out of stock.

Product buttons are simply showing "Out of Stock".