Okay, but he still has to go toe-to-toe with Tony. You don't build up a massive foe, then have him do someone else's work. You simply rule from behind the scenes.
Also, he wasn't in them too much because he was separated
from them, and the suit was damaged
, you know, when he got shot to Tennessee. I would think of all people you would be fine with a hero not being in the movie for the entirety of it, Ang Lee didn't have the Hulk appear until some 40 minutes+ in.