I think it comes down to playability. Its one of the easiest zelda games to actually play, there aren't many unskippable tutorials, its fairly easy without being a cakewalk, theres no particularly long sections. The only thing people cringe on is the water temple but aside from that you can sit there and beat it and enough stuff happens that its never really boring.
Windwaker has the triforce hunt, twilight princess has totorials, Phantom hourglass has the ocean's king temple. Like almost all of the games released after lost a piece of what makes the series fun and/or had a major flaw in their playability.