There are lots of reasons to dislike Lance the rider from the perspective a fan watching a spectator sport, and many of his contemporaries fit the same description of being hard-working, driven cheaters. So I don't buy it that Lance is above contempt merely because his accomplishments were great. Jan Ulrich was a all-around nice guy, and deserved admiration a lot more than Lance in my opinion.
As a fan of the sport, for fun, just like other sports, you pick and chose your heroes. Lance is derided by many cycling fans because he was universally applauded by most Americans without any nuanced appreciation for the sport. Americans who loved him for purely patriotic reasons (we DOMINATED those fucking frogs - Yeah!). If Andy Schleck were to chase down a second tier rider in a breakaway just to ruin his day because that rider had the audacity to speak out against doping, aficionados of the sport would hate Andy. If Sastre faked a bad day at the bottom of Ventoux, then chased down the solo breakaway leader just to "gift" him the win, we wouldn't think he was a very nice guy either. If Frank Schleck tried to bring back his team leader during one of the most decisive attacks of the TdF, because he felt like HE deserved it more, we'd wonder why Frank was still riding. Lance has done all of these things at one time or another. Sure Lance worked hard, sure he used dominant tactics and a strong team to win the tour 7 times, sure he employed similar "enhancements" as his main GC rivals, sure he was just a little bit better each time. But he was also a fucking dick on the bike. He sucked then, and he sucks now for that reason.
As a completely separate issue, if he goes down, it will be because he used federal funds to institute organized doping. It's pretty easy as a FAN of the sport to find that morbidly satisfying for the reasons discussed above, the same way we find it morbidly satisfying that Barry Bonds was indicted.