Of course he didn’t go down without a fight, would you sit there and be beaton by multiple persons? The problem is the gang versus one mentality.
Even if he DID attack a whole group, (and unlikely being as his wife was there, unless they said stuff about her too which is possible) I’m sure they could have just pushed him away.