Heck of an example for his kids, eh? I mean, does he want to subtly teach your kids that they should not try to get right with God? Does he expect them to “do as I say but not as I do”? Does he want them to always run away from their problems in life rather than face them and overcome them?
The problem here is that he thinks he lives on his own little island where his actions only affect himself. He would like to think that your example of reconciliation will be enough to offset his personal spiritual neglect. WRONG. Study after study shows that a father, more so than the mother, sets the spiritual tone for the family. In households where the mother goes to Church with the kids and the dad stays home, kids tend to lose the faith. I would say the same thing holds for the other sacraments.
You need to sit down with your husband and ask him where he wants to lead your family: to Heaven or Hell. What does he want for his kids, and if he is willing to change for the sake of their eternal souls? It’s that serious, and only the heroic Catholic family will survive.