When you pre-emptively move off line and arrive 'behind' it cannot actually escalate the situation. You would have to feel it to know why but I'll put it this way. You would have to imagine yourself as the attacker and just as your committing the opponent is there close but 'behind' you, possibly with a knife to your throat. End of play.
Now if I remove the knife to throat bit the same applies. You automatically know you're done for. You have already lost. The nage is in total control by position ready to end it and boy you know it. You know it's finished, over, done. No escalation is possible. That's the whole point of irimi in the first place.
I guess I, and some others taking part in this discussion that have, it appears, somewhat different experiences outside the dojo, would have a disagreement with you about this point.