I considered it last spring for DS but the new school district we're in is putting him in their self-contained gifted program and I want to see how it goes before giving up. If I homeschooled it would probably just be for a couple years, not permanently.
In terms of what your Dh thinks...I can see his point to a certain extent, but adults have choices. If an adult hates their job they can look for a different one, go back to school and switch careers, move, etc. So shouldn't a kid have choices too? As long as you are able to reasonably accommodate it?