When he tells them he doesn't care what they think? They feel disrespected, because they are in a role that commands respect. Whether he actually respects them or not, the social convention is to speak respectfully to people in that role.

If you don't understand this, it makes life much harder.