Category pages limited to 5 products when paginated

When Store Settings > Presentation > Product List Settings is set to "Yes" Paginate, the category pages are limited to 5 products regardless of the number of products set per page. The base Product page works fine and displays the correct number. It is when you browse by category when the paginate setting is activated that I'm getting 5 products per page.

Not sure why this is the case, but I'm wondering if this is because of how WordPress handles Archive pages (isn't that what Category pages really are). If that's the case, is there a code snippet I can drop into functions.php to get some control of this?