There are usually reasons why a man stops being interested in sex; especially if things were good before.
Let’s rule out unfaithfulness, as that seems to not be the case here.
So, he could perhaps not be attracted to you right now; he could feel strange now that he is the father and he is having relations with the mother of his child - it’s weird, but some guys do get that. His external stress could be getting the better of him, or he could feel like the emotional connection you once had is no longer there.
Many of you women are now laughing at me for the last item. I know, most guys ideal date: come naked, bring beer. I fully understand your doubts.
When a man is married to a woman he loves, though, things are different. He desires her, not just for her looks, or what she brings to the table - so to speak, but for how being with her makes him feel. When that changes, he can suddenly get a lot less out o the act than he used to. Then, he may start to feel guilty because he doesn’t want you to see that he isn’t enjoying things as much anymore, especially if you’re tired or worn out and offering yourself to him out of love. His guilt and selfish desire to want things the way they were can make him decide that it’s just not worth it.
How is your relationship? Don’t just assume things are physical with him; he may crave your touch and you’re too tired or busy with the baby for him. He may want time alone with you and you are staring into the eyes of the baby making cooing sounds. He may wonder if his life is altered forever and he will never again have a wife, just a mother to his children.