Sure they can, and the best way to avoid that is to not put yourself in the position to kick your ass kicked.
How can you do that without living in a cacoon?
Seems to me the majority of violent crimes happen in places the public frequents the most.
Restaurants, malls, and so on?
You going to stay home and hide from danger?