If a kid is a really fast swimmer I don't think spotting peers a year is going to make that much difference.

The top freshman are still faster than most of the upperclassman as I remember.

(and it's not like a team sport like hockey or soccer - in swimming you race against the clock so any good recruiters will take that into account too along with the age of the athelete).