I'm a maximum eye contact kind of person, myself, so I've had to learn to release other people from eye contact so this doesn't happen to them.
It's also why you just shouldn't try to engage me in a deep conversation while I am driving. Especially if you are in the car with me, and wish to arrive at your destination intact and on time.
BTW, there are other cultures (some of the North American First Nations come to mind) where full eye contact with a speaker is considered quite rude, especially if there is a status difference between the listener and the speaker. A disproportionate number of Bureau of Indian Affairs students were punished for this back in the day.