Thanks for all the responses. It's one of those things where the type of parent I want to be (one who doesn't limit these things) doesn't seem to be the type of parent my child needs. It's probably the only thing that makes me feel like a failure as a mom.
IMO: That's not failure; that's your ideas meeting reality and making adjustments.
Our DS10 definitely needed a radically different kind of parent than we were prepared to be; we became the parents he needed, and it was hard, but it was the right thing to do. I think you have to parent the kid you have, not some imaginary vision of the kid you thought you would have...
DeeDee