To make a channel private and only accessible by certain groups:
Turn off 'Set as Default Channel' button
Turn on 'Set as Private Channel' button
Then add the groups you want to be able to access the channel.
Setting a channel to private will make it so that it's not discoverable, and it can only be accessed by the groups you added.