That is a self-contradictory argument. Because by it you are in fact “imposing” your morality against those you disagree with.
There is nothing logically inconsistent about it. Of course every “ruler” imposes its value system upon the ruled,
at least to some extent. In the times when the catholic church ruled supreme (and don’t even think that there was an **independent **temporal authority back then), every facet of life was prescribed and proscribed, and the church was happy with that arrangement.
Now that the “shoe” is on the other foot, and the rules are changing,
some members of the church started to complain about “persecution” and “interference”.
But there is at least one huge difference between the two setups. The religious people are more than welcome to consider the lifestyle of “dissidents” as deviant, disgusting, abominable, etc… No one tinkers with their
private life. (As the bumper-sticker says: “Against abortion? Then don’t have one”.) What they cannot do any more - hopefully - is to create the legal system to impose their “value”-system upon those who disagree. However, when they come out into the public sphere, then the rules are applicable to them. Yes, those bakers or photographers who refuse their service to some because they disagree with the customers’ sexual orientation are now SOL.

But they are always free to accommodate the customers or change their profession.
You had your time under the sun, when you could declare that homosexuality or adultery are crimes and prosecuted those who engaged in those “criminal activities”. Nor any more. But you are still welcome to your freedom of conscience within your homes and your churches. And if that would be threatened (it will not) then you can come ask for our help. Guess what, you will get it. As Voltaire said: “I disagree with what you say, but I will defend with my life your right to say it”.
So, don’t be a sore loser.