It is alright to be a family man. It is a GOOD thing to love your family, but it is possible to be a good parent and an aikidoka. I have known people that can pull it off, and I have met their wives and children who don't complain. Why do you think that you are so special that you have a busier life than all of the people who are now shihan?
Out of curiosity, how many shihan are parents? Or, let's be blunt, how many shihan are not men who have dumped their parental responsibilities onto their wives?
There are, and always have been, plenty of men who are deeply dedicated to their career or profession or whatever, and who are fathers only in the biological sense. That's very different from being a parent.