Don't know if "justified" is the right term, but if you put your hands on some random broad's ass, this is always a potential consequence. You run the risk of a guy who can sleep ya, putting you to sleep.
That said, there are also consequences to clocking a dude. Especially if they crack their skull open on the ground and get brain damage or die.
We all have choices to make in this life. Although, I think One Punch Man will get some empathy in the courtroom if he gets charged. That wasn't a cat call. That was straight up sexual assault.