For what it's worth: Wearing hand me down clothes has been the norm throughout most of modern human history. To the point that it's been a major influence on fashion. For example, a lot of the ribbons and trim on Victorian clothing was a way to cover up where the clothing had been altered or repaired after being handed down (often from an employer to their servants).
I don't say that to be critical if wearing previously worn clothing bothers you. I just bring it up because sometimes things stop bothering me once I realize that they are fairly common experiences.
I know that wearing hand me downs was common in history. I've worn plenty of hand me down clothes when I was a baby/growing up. But currently, where circumstances aren't pressing, I refuse to wear clothes worn by somebody else. I can be a bit of a germaphobe, so that probably explains most of it
I am talking about in normal, everyday (for me) circumstances, this would likely not apply in dire circumstances