This is an old thread I started on Preschooler's Passions that may give you some ideas of activities.

DS is now nine and in a charter school that allows him to take math two years above level. He always liked numbers and has an excellent memory like your little one.

Follow his interest always and don't be shy about teaching beyond "age appropriate".