Numbered page navigation not appearing

On my "archive" pages (the pages that show all posts from that category) I would like at the bottom 1, 2....7, 8 for page navigation to older posts. I have used WP-Page Navi plugin and it doesn't show up (worked fine on a different site I have) and also installed Visual Pagination plugin and it's not appearing either.

This page is an example of where I would like it to appear under the last post. there are 9 posts in this category but only 5 are showing up with NO LINK or reference to the others.

Thank you!