I wouldn't worry about it right now while you have so much else going on in your lives. It might be important in a year to re-examine it and see if he wants/needs more math. I don't know how much math colleges expect so you might need to check into that if he is college bound.

Hope things improve for you.

What I am is good enough, if I would only be it openly. ~Carl Rogers