There's a huge thread on B.T. about casting going on, and I already posted my mini-rant on why I don't think SV is necessarily negative baggage for Tom in terms of playing Superman.
But you know what? It doesn't matter. It's all about what playground you are posting in. FWIW, this is how I feel about it.
Here's why I don't think that the SV baggage isn't a big issue for Tom:
The general public, and even casual viewers, only know that there is a show about Superman on somewhere/sometime and this is the guy that plays Superman/Clark Kent. They couldn't possibly even name the supporting cast, let alone want them in a big screen movie.
The majority of die-hard SV fans, who for the most part are an extremely disagreeable bunch, do agree on one thing - Tom. They are a guaranteed ticket sale no matter what. Whether they do or don't want the rest of the cast in the movie (and I would bet most do NOT care either way) isn't really a factor since their numbers are a drop in the bucket.
The fanboys who hate the show with all their indignant fanboy passion would almost assuredly still see the film. After all, it's still a Superman movie.