I'd rather have the best possible performance for Batman than a muscular Batman. So I'd rather have Pattinson than ATJ.
But I'd also rather have the best possible performance for Batman combined WITH a muscular physique. So I'd prefer if Pattinson jacked and went through a significant transformation much like how most superhero actors have done (like Kumail Nanjiani who bulked up considerably for a character absolutely nobody cares about) which was a reasonable expectation.
I don't really like the idea of having to cast small dudes for the criminals he's going to fight in order to make him believable, that just feels kinda lame, Batman should terrify even really deadly, really scary-looking people.
So yeah, even then I'll still be disappointed, maybe the batsuit is really good and the fight choereography really sells you the idea but even then I'll still be somewhat disappointed lol.