I think you have to discuss this in light of the age of the child. As for as colors and such, we do it as a part of reading, playing..."Can you hand me the green crayon?" eventually they get it. We have some fun books where you look for certain things and we do it together. "Oh lets count the black spiders. one, two, three...." I've never had a problem w/ my kids quizzing others or having issues w/ communication.
Now w/ an older kid doing add/sub/multi, I'd play games. Some kids enjoy quizzing as part of a game. At some point, there isn't much way around it. At some point in life, there will be a quiz to show what you know. My 9yr old is soooo much faster at math facts and such when we're playing games. I think b/c it's relaxed and fun. Now give him a sheet of paper and pencil and he's much slower, making sure he's right, looking at the timer etc.
Some ideas. Do you have Chutes and Ladders? Use 2 dice instead of the spinner. Add them up. I modeled not counting the squares to move and soon my kids followed suit. So if you're on 12 and roll a 6 and a 4, you say 12+10=22 and jump to 22. If DC is into negative numbers, you can do 4-6=-2 and then move backwards 2 spaces if that puts you in a more favorable position then moving forward 10. Or you can do 6-4 and only move up 2. There is a fun dice game where you have a target number and using the other 3 dice try to get as close to the target number as possible. Rightstart has a nice games package which many use to supplement any math program and would be good for afterschooling as well. If you need more ideas I'd be happy to list more.