I was also in a pull-out program as a kid, starting in grade 2, and although it gave me all my best memories of school (great field trips, interesting experiments, fun dramas), it did nothing to address the fact that I wasn't challenged in the regular classroom. It was more like a fun club or extra-curricular activity that I got to participate in a couple of times a week.