You need to worry that your son's behavior will become ingrained as a response to all things that bore him and then will spill over into all things that he does not want to deal with.

I'd search on here for testers and psychologists in your area. They would be the first place to start. They can give you your options on what you need to do based upon an evaluation of your son.