He's trying to learn. Answer as much as you can stand, then answer a bit more, then take a break. It is okay to say you need a break from talking or that you need some quiet time.

I'd also suggest getting a break when you can adult conversation by getting together with other families with kids and by getting out of the house sometimes when you can. In my experience feeling really annoyed with stuff like this is a sign you need more time off.