Ehhh, I think I might agree with what you're trying to say, but I don't think I'd say it this way. What other people think of you is a great source of information which shouldn't be discounted. In fact, I think there's a lot of value in soliciting feedback from the people around you.

We have a name for people who don't care what other people think: narcissists.

What I think you're getting at is that you can't please everyone, and there are many cases where risking someone's opinion of you is the right thing to do.