You see, if you don't swing at the first pitch, you might get a better pitch to hit later on. There is NO guarantee that the first pitch will be the only good or the best pitch you see.
And when a pitcher first comes in, you don't know how he's going to pitch, that day. He might not have good stuff and if you're out on one pitch, you won't know that.