If the children need to be protected, then of course, he needs to go. I suggest that you get some professional help on this. You might also check with Al-Anon. You are in my prayers.
DISCLAIMER: Catholic Answers has turned over the archive to Catholic-Questions.org and no longer owns, manages, or moderates the forums. For additional apologetics resources please visit www.catholic.com.