I remember one of my kids being in the YMCA childcare room with his age mates and he seemed much, much older than them.

If they won't move your son up an age group I'd switch him to a different place.

BTW - I think the teacher is way overstepping and I would be very upset too.