Also can you tell me if you can draw uke in without moving your hands inwards? I've been trying to achieve this too.
If uke is pushing and you want to break their power and draw them in, don't move the hands back. Move them up and to the side a bit, kind of like tracing an omega sign in the air with your hands. Breathing in sharply from the diapram can help as well. Do not pull your hands back. That only works for me if I am stronger than the other person.