Joyce @thistle is spot on. A one-on-one session with a professional street photographer resulted in the same point being made to me, and from that point forward I have never asked - and it has never been a problem. Conversely, the only times I've had trouble is when I did ask.