First, I applaud you for having realized that, at some point, the mature adult (or maturing developing adult :)) needs to move on from making decisions as a reaction to circumstances imposed by one's past or by others, and start considering one's own long-term values, goals and health. Living reactively simply abdicates power and responsibility over one's own life to others--typically the very persons whose influence one wishes to leave. Plenty of allegedly mature, allegedly adult persons have not had this epiphany.
And, as you note, the K-12 experience is time-limited, and a much smaller percentage of a typical lifespan than it may feel like while one is going through it.
FWIW, I have met a number of persons around your age in my professional capacity who are in similar situations, either in their perception of expectations, or in the actual expectations of their adult caregivers. Sometimes the label has value for early access to resources and nothing else, but sometimes the label also has value in identifying the source of internally-generated pressure. (And in the case of twice exceptional learners, the label can be an important counter to the labels of failure or disability that the individual may have acquired or self-imposed previously.) Whatever the case, labels become problematic when they subsume the identity of the person; no individual can be wholly described by a single dimension of their development.
As someone who was a gifted child, grew up with gifted children, has raised gifted children, and works professionally with students including gifted learners (usually twice exceptional), I am entirely sympathetic to your experience. I had the benefit of parents who did not believe that my IQ or GPA was the sum total of my value, but I definitely had peers whose experience was more like yours. And yes, one's reputation follows one rather closely in a limited community, for good or ill. (Sometimes it's not even your own reputation. I have a substantially more gifted older sibling--try receiving this backhanded compliment: "You're surprisingly normal for a (member of your family)!")
But I do want to emphasize the optimistic outlook I see for you, because you are learning to transcend the messaging that you've absorbed over the years, by looking around at other perspectives, and thinking deeply for yourself about where and why learning occurs, about who you are, and about where your value resides (hint: the value of a human is not in their intelligence, accomplishment, or--please!--earnings, but in their ideals, their internal sense of joy, peace and beauty, in their relationships with others...in their unique and unrepeatable presence in the universe). Moving forward, however others interpret your behavior (e.g., as compliance to their authority, as rebellion, as something in-between), you will know that you are making thoughtful choices that respond--not react--to your own values and goals in life.