Its good to train hard at times. Makes you appreciate the soft. As with all things however, take the middle road.
"Hard" training is very different from "violent" training.
Sounds like the OP is verging into violence and doesn't like it when the other guy escalates along with him, but that's the virtually certain result of getting violent to begin with.