The problem is that he's known to give up home runs, so that first man on base could be a run.
There was a two-run lead. With a one-run lead I wouldn't even suggest keeping him in. With two-runs, I realize if he puts a man on it brings up the tying run, but I'd take the chance.