As another beginner to aikido, I understand your frustration. I also find myself working against strength moves from time to time. I think that your reason to leave the mat was a good one and I think that talking to sensei is the best next step.
If your are correct in thinking that no one else wants to work with this bozo, perhaps you can mention that to sensei at least to the extent that you would like suggestions on how to deal with the strength moves.
As encouragement, if you continue to have more hours than him, at some point all of the moves and techniques will start to click and you will be able to deal with him. The potential, at least, is there. He is providing a great deal of energy that is available for redirection.
Good for you for controlling your temper, too!