Gymnastics and swimming are individual sports too. Having a 7 year old play in a 12 year old rugby team would be more of a problem.

To be fair gym coaches are passionate about gym whereas a primary teacher may be passionate about writing but hate maths and science.

A change in mindset and attitude would help though.