It is certainly possible for a middle-aged person to learn calculus if they first get enough background in the math leading up to it. Plenty of people successfully go back to college in their middle age.