The only way you can kill it is by destroying the brain or severing the head...it just keeps coming back if you don't!!!
Severing the head, huh? Time to get the bokens out and start practicing decapitations. Remember, In The End, There Can Be Only One (Zombie Thread