I would just ask. Politely. "I'm sorry, but we had something else planned for that day." (I assume this is fine bc of the homeschooling arrangement.) "I'm sorry if this is creating an issue for you, though! Is there a logistical reason why it's important for him to attend?"