Its basic, create a new permission on Edit Channel for change allowed groups to join on channel.
Example:
Group1 and Group2 have permission to join on Channel1
Group2 and Group3 have permission to join Channel2
More Group3 don't have permission to join on Channel1 and Group1 to join on Channel2.
This is impossible only Join Power permission.
Tanks.
Sorry my bad english...