Loki882 actually summarized my thoughts on this much better than I so I'll just quote him.
Originally Posted by Loki882
My issue with it was more that this is the group that originally crippled him, kidnapped him, and held him captive for months, and the Mandarin is apparently their leader. And yet, that never really comes up, at no point does Tony seem to really ponder this or have it weigh on his mind. It was a missed opportunity.