Good point on adapting to what they are interested in. I have done that with sports over the years. When D was interested in tennis, we played tennis. Her teacher had back to back group kids/adult lessons, so we took lessons together. We went to tennis camp together, too.
When our kids were little, we did a lot of cross country skiing. When our kids got old enough to race on the school team, I tried racing in adult races. We could go out for weekend skis together.
I figure it is a good way for me to get exercise and spend time with them, and they have enjoyed it.