I don't think that it's a crazy idea at all - I'd consider that many *many* people make the decision re where to buy their house based on the reputation of the school district they will be living in (gifted children or not).
That said, there are other reasons I'd consider *not* moving when you are already established in a home - if none of these are considerations, then yeah, a move is ok. If any of these are issues, I'd not be so quick to move. It's really *tough* knowing there are potentially better schools out there "if only" you could move, but the flip side of that is - school is just one part of life, and sometimes not everything is able to work out and other things might take a higher priority. So here's what I would consider as reasons not to move (and conversely, depending on the answer - reasons *to* move):
Financial (if you are a home owner) - how long have you been in your current house? How much of a loan is left to pay off? If you're heavily into having paid off your loan, are you going to take a hit in terms of potentially losing value over the $ you've put into the house? Or will you be ok or make a profit? What is the difference in expenses (house and cost of living) between where you are now and where you will be living?
Neighborhood - do you like your current neighborhood? Do you think you'll enjoy your next neighborhood just as much? Are there major differences? Traffic? Yard space etc? How long have you known your neighbors? What types of relationships do you have in your current neighborhood? Are there families you can depend on in an emergency? Are there other children for your child to play with etc.
How 'real' is the reality of the better school(s) in the other school district? Are you basing your impressions on what you've read, what the school district says, or what other parents in the trenches have told you? How reliable are those other parents' experiences relative to your own? Do you know the people who've given you advice well enough to trust that what they are saying is really what's up? Or to know how to filter what they are saying to give you an accurate picture
Will you have regrets if you move and find that the new school isn't all you'd hoped for it to be? Will you still be happy with the move?
How much will it cost to sell again and move back to where you are?
Just a few cents worth of what I'd consider!
Good luck with whatever you decide,
polarbear