>I've seen some people wear a rash guard over their PFD to eliminate possible things to catch on<

Whether it is psychological or not, a rash gard over the PDF is for less wind resistence (see attachment, don't know if red+black makes one faster).