I never got why some fans like to bash certain games in the series when outside of Minish CAp and Four Swords, I don't think there has really been a weak game in the franchise (and those two weren't main titles).
MM for example I find to be genius and to have as much nostalgia as OOT to return to, even if the storyline isn't as good and I was initially disappointed by not getting to revisit Hyrule which was an amazing world to my child mind in OOT. But the game's strength is its presentation, its depth and its content. THERE IS SO MUCH TO DO. I have to say if anything disappointed me in WW and TP (besides boss fights being WAY too easy), it is there is not nearly enough sidequesting and NPC interaction.
In TP, which I love including the wolf sections, it is pretty much this amazing epic sotryline and a crap load of great mini games. But the only side quests are collect-athons. Not really so much to do. But MM had us travel around the world in 3 day intervals and try and make every single character in the game's life better before the end of the world. And they are all doomed and they know they are doomed. You see how it affects every character differently with denial, anger, regret, fighting, dispair or acceptance. The game is about death and renewal. Every major transformation mask you receive (minus the deku scrub) you receive from the death or suffering of another. The Goron, the Zora even teh stone mask. And all these characters are about to die and it is a tragic thing and knowing each's story gives the game so much more weight.
So what if there are only 4 dungeons? The world is so much bigger in the sense of content and purpose that no Zelda game before or since has matched it and I think that is a shame. You really got to know the people of the ill-fated Termina as the shadow of death (in a lurking moon) laid above you. Seriously every day the music getting faster and more ominious, the people getting more paranoid and the moon getting closer was brilliant. Having to relieve the same weather conditions and suffering...amazing.
OOT is better and probably TP (it's hard to say) but I do love MM.