I always advise my kids to staple on a 45 degree diagonal. This results in the least stress and thus minimizes the chances of the paper ripping.

I had a professor who deducted points for horizontal/vertical stapling. Since some kids didn't follow his reasoning, he spent an entire lecture proving his point. Since then, I have always stapled at an angle.