This reminds me of a conflict I had with my first grade teacher. I explained that I was quite able to read actual chapter books.

I recall winning that battle by proving I was able to read them.

In your situation, I think the teacher is way off base. Although it probably doesn't do much good to fight too aggressively unless you can get a group of parents together to prove that the teacher is way off base.