As you say, a few percent difference in density, so your boat will float a bit higher in salt water. But I haven't noticed any difference (as a mostly lake sailor).
What I have noticed is the difference in sound. Salt (or sea) water makes more of a shhwshhhing sound (more bubbles?). I thought it was quite noticeable. Anyone else?