Many male physicians are also working part-time, esp. younger doctors. Men want to participate in their families too!
The arrangement you are describing is why female physicians (or female scientists, etc.) can fall into the "mommy track" at many universities. It becomes very hard to get promoted to tenure for these women.