Despite martial training we have to be intimidated. The samurai were prepared to die, every and any day of their lives. They were prepared fight and to die as punishment even if they won the fight(Hagakure).
There are aspects of Budo training that don't apply today and this is one of them. I'm not prepared to die and I am very prepared to be intimidated.
I also think that defusing skills are essential - not just staring down (cause this won't work if you aren't 6'3 but other gaze diverting and body-language techniques. Avoiding conflict is not enough, you must resolve it (so they don't come after you tomorrow)