Custom Sidebars on Custom Taxonomy Archive pages

The sidebar is showing properly on (Page) and pages like single CPT like

Can't get it to show on the tax pages though, I've tried playing with the Visibility per widget, but seems the settings don't save (or is supposed to work some other way). I've also tried just calling the sidebar directly in the template for those pages, but then the widgets aren't wrapped in li's. See for a quick video of what I've tried.

How to get it to show up properly on these pages as well?

Thanks much!