The correct way is to hold it by the handle ;-)
This video has been posted before on these forums but at 4:40 he starts talking about the "proper" way to hold a knife. It's pretty much what Mark said.
(The whole clip is worth a look. I think it puts aikido tanto training in context).