That's hyperbole. He was still solidly built. Just not huge. His traps and back were great in all three films and they are one of the most important factors in filling out one's frame. Even at his smallest, Bale was still much bigger and better built than every other man who has worn the Batsuit to date.