I heartily agree with this recommendation. Our 5 y.o. son loves to listen to many of the Jonathan Coulton songs with me. While the Princess Who Saved Herself and My Beige Bear are (I believe) the only songs specifically written for kids, there are a bunch that work well for all ages listening. Some of our son's favorites are The Presidents, Washy Ad Jeffy, Mr. Fancy Pants, and Je Suis Rick Springfield.

(I also agree with the pre-screening of songs; some are decidedly NOT kid-friendly!)