We use a gifted private school for DS4 and his immediate peer group for class and recess is < 20. So I don't think a huge group is really needed as long as a child can form a few good friendships. As long as it's safe and well run is there really any downside to trying it out? Can your child do a "shadow day" to try the school before making a decision?