I let embarrassing memories make me miserable a lot, and when I complain about it, the number one tip I get is "It's been so long, nobody even remembers besides you" or "nobody even noticed". But I remember a lot of embarrassing stuff that others did. I remember a lot of things that make me not like them as much even today. And I notice a lot of those "nobody notices" moments, like when someone picks their nose or has a nip slip. So if I remember and notice, why shouldn't they?