That seems to me to be a bit myopic. It's not strictly about color. It's only a means to assist in learning. After some time, the colors will mean less because the moved will be innate.
I agree, it's not about color -- but whatever means you use to designate the ends of a jo as "this end" and "that end" seems to have the same potential problem to me, for the reasons previously explained.