Ultimately, it is the players that make the difference. The same team with the worst manager versus the best manager likely won't see a difference of more than a ten win swing, and some believe the swing isn't even that dramatic.
I'm clearly of this persuasion.