showing blank categories in woocommerce

In woocommerce, is it possible to still show a category on a page even if there are no products to put there yet? The client wants to still wants to show the category in the list even though there are no products yet to put there.