Path to custom template files

I'm writing a custom template for the q&a plugin and I notice the custom template files are not recognized if they are within a sub-directory inside my theme.

My theme has a LOT of files, and there's a tendency for things to get messy and confusing, so I'd much prefer to put my q&a files in their own folder (ex: /wp-content/themes/my_theme/qa). Is there any way I can over-ride the default path to allow this to work? Perhaps there is a global var or something that would allow me to specify this.

Thanks!