I've seen this proposed (in a meme ): Him: I've got a place picked out for us to eat. Her: Where are we going? Him: Guess. Her: *makes a guess* Him: That's right, good guess. (proceed to go there) Luckily I've never had to employ any fancy tactics. My wife is extremely easy going, and is happy to go eat just about anywhere. In truth, I'm far more picky than she is.
I think it depends on the psychology factor. If people have the option to flee, then many will when the Silverback absolutely stomps the first few guys to enter the fray. If the men have no choice and no escape, and we consider them to be essentially immune to psychology / unbreakable, then I think they have a fair chance.
Many factors are to be considered... what i believe to be a decisive point is that we're talking about average men. Many of them will simply be not qualified for such a fight, plus there will be a lack of coordination (the key point to victory, which would be factored if you pick a group of people that know their role in hunting, as rural villagers) and some of them will panick regardless the presence or not of an escape route. Plus...