It sounds like you are fulfilling all his needs: socially and intellectually. I know that in today's society the norm is to put your child in school but it doesn't mean you have to. Our parents' generation ... okay mine anyway ... it wasn't expected and most kids started school in Kindergarten.
There are positive and negative to any situation and you have to way both sides which it seems you have. If it were me I would continue with the approach of now and re-evaluate my choices in the spring (March/April).
