How can I set the same widget so it can only be used by a specific group

I want to have an upload feature set as a widget in the left side bar. But, I want it to work ONLY for the specific group people are logged into.
So, If I have 3 groups, I want them to be able to upload only to the group they're logged into. Does this make sense?