HaHa. I think he is registering his displeasure. I admire how you are putting yourself out there and shooting strangers, something I have never been very comfortable doing. I do it but I try to be surreptitious.
@cdcook48 Chris, I do use my long lens. He might have looked my way, but I doubt he thought I shot him. My camera does not have a viewfinder. So I was holding the camera quite low, around waist height and looking into the display. So that might help mask the fact I am photographing. When I get smacked in the face with my own camera, I'll let you all know.
(it makes no differents but with a smile you feel better.)