Just to make sense of what I wrote, what I meant was that after you acknowledge the fear, if you're like me, you're then able to smile in a friendly way.
However, I have had the experience over the last year where a person felt that my indifference was the green light to push me further. If they're calling you names, they response is "Yeah, that's true. What do you care?" If they say they'll get physical, the response is,"I hope not, I'd hate to lose a fight. Plus, whether I win or not, no one ever walks away from a fight without getting hit in the face."
Just my experience, but stuff like that seems to make people think.