Taking someones picture without their permission seems likely to cause some folks to get a lil pissy. I know I wouldnt like it.
That's the chance you take when going out in public. There's no law against taking a public picture, whether it's for distribution or not.