For a civilian, punching Bane's mask with your bare hands, would hurt. However, I don't think Batman was targeting his mask in the first fight because the sound effect was different. In the first fight, it sounded like Batman was punching Bane's head. In the second fight, you can hear a "clicking" sound when Batman was hitting the mask.Then it's the mask. I know Bruce is not on top of his game but any person Batman or a regular civilian in a fight with bane would target his mask. But the first fight as I said was really great, the second fight not so much. Bane was defeated way too easily. Why is Batman sitting here listening to Talia and letting Bane tie a rope around him? Why did Bane even put a rope around him? He was going to just shoot him.
The movie version of the 2nd fight sucked, especially with the cut scenes. If you watch it uncut on Youtube, it's a lot better.
But yeah, overall, the 2nd fight wasn't very good.