Just rotating isn't going to destabilize a competent uke. You need to disrupt their alignment somehow.
From there, the feeling is more of the hand falling toward your own center, NOT pushing/pulling uke downward.
I second this. In addition, I find a good guide is to make sure your elbow rests against uke's spine. This will prevent your from pushing with your hand.