... if you work out enough or hard enough, it always seems to hang down.
Maybe find another way of tying your hakama? I myself have never had this problem. And only seldom I see it at other student. Mostly when they ty their hakama "wrong" or loosely.