Math teacher here. Fluency and speed are not the same thing. Just like being fluent in Spanish is not the same as being able to speak it really fast. Yes, if you are not fluent you cannot speak fast. But you can be fluent and not be a fast speaker. And, I might add, there is much value in speaking slowly and precisely and precious little in being able to speak fast.
People who think fast and talk fast probably are judged to be more intelligent -- think of the phrases "fast on his feet" or "quick study". The association of speed and intelligence has some justification. As people age, their fluid intelligence declines, and they think more slowly. I've noticed this in my parents, alas. To what extent speed can be developed by drilling is a different question.
