Definitely sounds like a misdiagnosis and Grinity was spot on with her book recommendations.
Gifted children without the added label of 2E (twice exceptional) are sensitive children. Your son sounds not only like my DD but like many others who post on this board. My DD has shown no signs of aspergers yet I can not completely rule it out. It really is hard to diagnose aspergers before they are 7 yrs of age, but as a toddler I haven't seen anything that would lead me down this path. She does have SI (Sensory Integration) and it sounds like this is what you are witnessing with your son. DD's SI isn't as intense as others but we have had some battles to overcome it. We still have to be careful with her clothes. She won't wear anything scratchy and definitely nothing with tags in it.
Here is a website that might be of interest:
http://www.sengifted.org/index.shtml
