If you have good training in other arts, you may be sensing an opening in your koshi. Have your instructor or a senior grade watch while you do it. Have your uke see if they can apply a rear naked choke while you do it. There are ways to close these holes, but since there are many styles of koshi, and this is not on the mat, its too hard to really describe for me. But someone at your school can probably help out.