If you want my opinion on Piazza and Bagwell, I think I'd probably vote for them. You're right that there doesn't seem to be much evidence against them.
I don't know where the line needs to be drawn - maybe just with Bonds and he pays the price for the errors of all the other PED-users of the era. But I do think that Barry Bonds should not be in the Hall of Fame.