No, you don't have to be. But it's easy to spend everything you have on it. And even for the rich, it's not an easy road.
I don't know about being rich to get good at Aiki, but I do know a number of people who have made a small fortune just teaching Aikido. Problem was, they started out initially with a large fortune.