No, there are absolutely 0 times when "you", an individual, are justified in defying the majority norm. It's only ever a question of not consulting a large enough sample size.

If your 4 friends are idiots, no, you shouldn't listen to them.
But if 10.000 unaffiliated strangers say that it is, in fact, you who are the idiot; then, you are.

And that is always the case, simply for the fact that ethics and morals - the very things that decide what "doing the right thing" even means, are societal constructs. They are made up by humanity on a group basis and, historically, peer enforced.

If, at any time, you decide that "you" know better than everyone else - you need your ego checked.