I have worked for a College and public school districts and what I see is there is a problem in the school district level (because of reasons I won't get into here but no fault of their own). Students are being pushed to learn to depend on calculators and not really understand HOW to do math. Then by the time they get to college they are having to take Elementary and Intermediate Algebra to get them caught up to the College Algebra Level. In the college I work for they aren't allowed to use calculators in the lower levels because they have to learn what they didn't in Middle and High School.
Since you are homeschooling you should be better aware of whether or not your student really understands the basics enough to remember them. So that should be your judgment point and if you feel that they are losing the skill you can decide to refresh those skills by telling them no calculators today.