Got myself in this fix a few times;

Also got the knack of sitting up in the trapeze, both hands on hips [Jam the tiller with your back foot] and glare at the trailing skipper until he really gets the message that you don't want him pushing you about!