Funny thing is, my sempai whom I talked about in the OP came to pick me up, got real angry and insisted that I don't do that again. But I know what I want now and what I need to do
That is SUCH a huge "run away and stay away from him" moment...m.a. should not be a cult, and when it becomes that controlling it means it is primed for abuse.
I bet if you take the bus a couple of times and really show an interest, somebody may be ready and willing to drive you back.