The situation doesn't have to be difficult. I know you may feel guilty about leaving your current sensei if you choose to do that. It's hard not to. But something my teacher told me may help:
9 out of 10 aikidoka drop out before testing for 5th kyu.
9 out of 10 drop out between 5th kyu and 1st dan.
In the long run, that's a 1% retention rate. Senseis should be used to this; it's just a fact of life. So if yours loses you, it will not be the first time - or the last. Go ahead and explore other dojos.
Here's wishing you great luck with your aikido!