Select what repositories I want my groups have access

When I create a group, I can't select what repositories I want to give my group access, Sometimes we have contractors, I don't want to give them access to all my repos, Sometimes I have a group for android developers, I don't want to give them access to all my repos where maybe some of them are web applications when they make android apps. I would like to have more control what group can see what repository.