Both my kids differentiate numbers by gender, but I think it is because you recognize and conjugate genders differently in my native language, which we speak at home.