Your sensei has told you and the other instructors to take control of your classes, so do it. If he wanted to place restrictions on your control, he would have done so. Do what's best for your class and the students attending. Immediately seize on his misconduct, correct it once, and then show him the door if it continues. That seems fully in keeping with what your sensei instructed you to do.