Sounds like you could have dyslexia and/or dyscalculia (math disability). If you had trouble learning the math facts like multiplication, that would have made more advanced math very difficult. Sounds like there should have been interventions done by the school system. Hopefully others here can give you more input.