If you’re not Catholic, and your husband is a non-believer, you’re not bound by the Catholic form of marriage; it’s only Catholics are who thusly bound.
(It’s worth noting, though, that your marriage wouldn’t be sacramental, because it’s to a non-believer; the sacraments are for Christians)
As long as neither your husband nor you are Catholic, I’d agree
Of course, the Episcopal orders aren’t valid; they’re not valid successors of the Apostles, because the orders aren’t given with the proper intent (i.e., with the intent to make them valid ministers of the Eucharistic sacrifice). But that doesn’t matter, because a valid successor of the Apostles isn’t required for a marriage (even for a proper Catholic marriage, in extenuating circumstances; even in ordinary circumstances, the bride and groom administer the sacrament to each other, and the priest or deacon is just a witness).
What are those? I don’t know of any biblical wedding vows, myself.
If he were a Christian, would you be biblically required to stalk him?
Is he a non-Christian, or a baptized Christian who doesn’t practice?
Praise the Lord for successful marriages

(I just got married less than two months ago, I hope to be as successful with mine as you’ve been with yours

)
Excellent. That’s one of the major things that drew me to the Catholic Church. It’s the only significant Church that doesn’t permit divorce under any circumstances.
Jeremy