With respect, Bronson, even that kind of kotegaeshi can be done and still you get hit. I did it that way for about 10 years (Seidokan), and realized I could be slapped.
What changed was where my body was in relation to uke. I found that if I folded uke in to me, it worked, but brought him towards me even if I was off the line.
To me, body position made the difference, but I still do the technique as you described.