clownfish colony

I’m a bit confused on clownfish sex changes work… I know if you just have a pair the dominant one is female and the other is male, but what about a colony? I was under the impression that any number of clowns had one female, one male, and the rest ungendered, but I am now told that “there will...