Ah, you're only a yellow belt, you're still very young, like me. We haven't yet reached the level of "no sen" (no mind) that is like the nirvana for martial artists.
There is a guy training with us who in a Kyokushankai instructor. He told us that one day, while driving, he had a minor collision with another car. As they both climbed out of their cars, the other driver angrily charged him with a club. He's not so sure what happened next, but the poor chap flew past him so hard that he grabbed him to keep him from getting badly hurt. The guy stared at him opened mouthed for a second or two, then hurriedly climbed back in the safety of his car and drove off, all the while screaming obscenities.
As our friend started he own car, he wondered why he hadn't just punched the guy into a pulp, the way his previous instructors had trained him to do.
You and I will get there, I promise you.
Now, go train.