You were mistaken. Some of the people that were waving at him were under the impression that he kept looking back at them but he was actually looking at the giant scoreboard. He was doing it practically on every pitch. Maybe he was keeping track of pitch speed.
Nah, the side boards died during the middle of the game and were out till the late innings. He was probably looking up for the count/outs.