Yes.
And maybe ask him, in his opinion, what’s the worst thing that will happen to the baby if you infant baptize him or her?
If you’re right, your baby becomes a Christian.
If he’s right, nothing happens.
Baptism is all win.
I also agree with MJJean about talking to a priest. Make an appointment and tell him that you’re both going. (If he won’t, you can use the appointment for yourself.) Again, logic him and ask him what’s the worst thing that would happen if he goes to the appointment? Why isn’t it a good thing to get more information? (You can use the same argument with regard to RCIA–why wouldn’t it be a good idea to learn more about his wife’s religion?)
Easy on the logic, though–there’s only so much logic that most people can take at one sitting. I’d only do one thing at a time. Also, tone is important, so try to keep a reasonably temperate tone.
Also, bear in mind that every year has multiple gift giving opportunities, and you can ask for the baptism as your gift until he cracks. “What do you want for Christmas, honey?” “I’d like to baptize the baby.” “What do you want for Valentine’s Day, honey?” “I"d like to baptize the baby.” “What do you want for your birthday, honey?” “I"d like to baptize the baby.” “What would you like for our anniversary, honey?” "I"d like to baptize the baby."
If he stands up to a full year of that of you asking for no other gift but the baby’s baptism, he must be made of stone.