Well, put in historical context, I don’t see how non-Catholics can argue the point.
There was only one Church for 1000 years after Jesus ascended to heaven. There were heretical groups which sprung up, but the heretics considered themselves Catholic. And the Church eventually corrected them through Councils.
Only in 1054 A.D. did the Orthodox schism from the Church, but they retained Apostolic Succession.
In 1517 A.D., Protestantism was begun by an ex-Catholic monk, Martin Luther. And Protestant Christianity has been splintering ever since into literally tens of thousands of man-made, doctrinally disunified denominations.
That being said, from a logical standpoint, IF we agree that Jesus came to earth and taught the Apostles His truth, one of two things could have happened: 1) That truth was preserved and brought forward through the centuries in the first Church which existed alone for the first 1000 years, the Catholic Church. or 2) That truth was somehow forgotten, lost, or changed, and with subsequent non-Catholic denominations it was somehow rediscovered. (Unless you think there is no sure way of knowing anything, that Jesus basically left us orphans with regard to His truth?)
If 2) is true, then the question becomes WHERE did the non-Catholics get the information to “correct” what the original Church founded by Christ taught? And can they prove that the original Church ever “changed” the deposit of faith handed to it by Christ? Do they believe, like Joseph Smith, that there was some sort of subsequent revelation? And if that is true, can they prove it? Joseph Smith couldn’t (he said the “plates” were somehow “lost.”).
The easiest, and most logical answer is 1), that Jesus founded a (one) Church, gave it the deposit of faith through His Apostles, who faithfully handed it on to their successors, the bishops, throughout the centuries. Jesus promised to remain with this Church till the end of the world. He also promised to send the Holy Spirit to guide it “into all truth.” Indeed, St. Paul says that this Church is the “pillar and foundation of truth.” (1 Tim 3:15)
So, I’m curious. IF the Catholic Church isn’t the original Church founded by Christ, where and when do you think it changed any of the teachings that Jesus gave it? What proof do you have? If not, who gave anyone else authority to found a different Church than the one Christ founded?
I think you get into a big ball of wax once you start trying to tap dance around the fact that the Catholic Church was the original Church that received Divine Revelation from Jesus through the Apostles, because then you have to find an alternative source. I don’t think you can.