That might be the case if he only did it every now and then with a runner on but that's his actual delivery so I don't see a balk there.
I understand let it go because that is the way he pitches and he has been in the bigs for 7 seasons. Like HOF pitchers who everyone knew threw a spitter, but were good at it.