Beyond a certain point, your potential will be less impactful than your choices.
"It is our choices, Harry, that show what we truly are, far more than our abilities." - Dumbledore
OP, there isn't any special "gifted track" in adult life, and having been identified as gifted in childhood means approximately nothing for your adult educational or occupational status. I was identified as gifted, and I'm disabled and live in crushing poverty. Life outcomes mostly come down to a combination of luck and what you make of it.
Gifted programs in schools are, at least in theory, about meeting differing educational
needs, not about being a status symbol. If your school treated it like one, that's very unfortunate.