I imagine most people feel the same way.
One big knock on the 64 for me, is that I'm a weirdo who doesn't care for Mario 64 very much. I also never played Star Fox 64. I like Super Mario Kart more than Mario Kart 64. I think all three original Donkey Kong Country games are better than Donkey Kong 64. The Kirby and Yoshi games on the 64 weren't very good in my opinion.
On the other hand I like both Ocarina of Time and Majora's Mask better than A Link to the Past, so the 64 has that going for it. Also Super Smash Bros.
The Wii U has definitely been better than the Wii and Gamecube for me. In my heart I already feel like it's been better than the N64, but I think my brain is just waiting to see how the new Zelda turns out before I can say definitively.