There's a young adult novel about a girl with synesthesia. It's "A Mango Shaped Space". I really enjoyed reading it as an adult a few years ago.

I think many people have associations with puzzles, magnets, etc. that may fade with age. True synesthesia is pretty rare, as far as I can tell. It is interesting though, that it appears to occur more often in the gifted population.