The nonverbal portion of an IQ test doesn't really require conceptual knowledge of math. (AFAIK, it doesn't require any math knowledge at all.)