Well we are all kind of careful about that, but bullies tend to pick on someone they can get away with picking on, heroes take on someone who is picking on said person, in a traditional reading of the matter.
I mean some KKK members are not going to march into the barrio and be like, "Where dem immigrants at?"
Just as a gang of conniving, blood sucking antifa members are not going to take on a guy who looks like Brock Lesnar unless their numbers exceed 5 and they have pepperspray and bags full of doorknobs.
It is the ancient maxim that when ready to revert to violence, you should be larger and heavier before making wagers on the outcome.
That should be natural in human nature, but some people have retarded themselves to the reality. It is the same reason one should not run up to a rhino in the zoo and slap it on the ass while shouting, "I am the dominant male!"
In the human zoo doing it to a smaller, weaker, likely older person might make the emotionally disturbed bully feel good, doing it to a larger, heavier person, most can understand... nature will invoke consequences, on their face.