DD had the same issue at her old school. There was only one class per grade, so there was no way to separate her from the boy who kept tormenting her. Inevitably she'd end up in trouble when she finally lost her cool at him. And despite the fact that there was only one teacher per grade, they couldn't be bothered passing along any information to the next year's teacher (like which children had issues with each other).

She also complained about too many kids in the class. She used to say the noise and chaos drove her crazy.

I've said before that the marketing and labeling schools do doesn't matter (gifted, accelerated, charter, STEM, etc.). An educational mismatch is a mismatch and either the school needs to address it or you will have to. It's hard to have something that sounds so right (gifted class!) and have it not work out, but many of us have the ongoing experience of the thing that worked for a while then stops working.