The gender difference already shows up at grade 1
http://www.mathkangaroo.org/mk/2014/2014_results_main.html
Not sure what are the causes though. Cultural bias is probably one.