Spot on, this is exactly how I felt. Even though I grew up on the Superman animated series, I mainly read Marvel when I got into comics, so even though I enjoy both DC and Marvel, I consider myself more of a Marvel person. With that said, I did not enjoy Avengers very much, but absolutely loved Man of Steel. Why? One of the main reasons being the final fight scene in the Avengers- I actually found it quite boring. Nothing seemed to be at stake. Sure, an alien invasion is taking place, but the Chitauris are being taken out by the heroes like chumps, and I don't see anyone ever being in any danger. In Man of Steel however, I was feeling really anxious as I was watching the final fight scene. I was invested, because I actually feel many lives were at stake here!
If the events of Avengers or Man of Steel happened in real life, the death toll would've both been very high. You don't get that feeling in the Avengers though. It was so dumbed down, as if it was a cartoon in real life. This was probably the reason it was more popular with the masses, but I personally didn't like it.