I'm going to try the water tax for a Saturday night game this year just for kicks.
Just an FYI, I thought about taking the water taxi to Nats Park because I was down at the National Harbor for Maryland Crab Fest. It's kind of steep for transportation at $25 but if you are taking it just one time for fun it's not bad.