the only early church was the Catholic church. the Orthodox church was established after 1054.
St. Cyril of Jerusalem, Patriarch (363):
Our Lord Jesus Christ then became a man, but by the many He was not known. But wishing to teach that which was not known, having assembled the disciples, He asked, ‘Whom do men say that the Son of man is?’ …And all being silent (for it was beyond man to learn) Peter, the Foremost of the Apostles, the Chief Herald of the Church, not using the language of his own finding, nor persuaded by human reasoning, but having his mind enlightened by the Father, says to Him, ‘Thou art the Christ,’ not simply that, but ‘the Son of the living God.’ (Cyril, Catech. xi. n. 3)
St. Theodore the Studite of Constantinople (759-826):
*Writing to Pope Leo III … *
Since to great Peter Christ our Lord gave the office of Chief Shepherd after entrusting him with the keys of the Kingdom of Heaven, to Peter or his successor must of necessity every novelty in the Catholic Church be referred. [Therefore], save us, oh most divine Head of Heads, Chief Shepherd of the Church of Heaven. (Theodore, Bk. I. Ep. 23)
St. John Chrysostom, Patriarch of Constantinople (c. 387):
Peter himself the Head or Crown of the Apostles, the First in the Church, the Friend of Christ, who received a revelation, not from man, but from the Father, as the Lord bears witness to him, saying, ‘Blessed art thou, &c.’ This very Peter and when I name Peter I name that unbroken Rock, that firm Foundation, the Great Apostle, First of the disciples, the First called, and the First who obeyed he was guilty …even denying the Lord." (Chrysostom, T. ii. Hom)
Peter, the Leader of the choir of Apostles, the Mouth of the disciples, the Pillar of the Church, the Buttress of the faith, the Foundation of the confession, the Fisherman of the universe. (Chrysostom, T. iii Hom).
Peter, that Leader of the choir, that Mouth of the rest of the Apostles, that Head of the brotherhood, that one set over the entire universe, that Foundation of the Church. (Chrys. In illud hoc Scitote)
(Peter), the foundation of the Church, the Coryphaeus of the choir of the Apostles, the vehement lover of Christ …he who ran throughout the whole world, who fished the whole world; this holy Coryphaeus of the blessed choir; the ardent disciple, who was entrusted with the keys of heaven, who received the spiritual revelation. Peter, the mouth of all Apostles, the head of that company, the ruler of the whole world. (De Eleemos, iii. 4; Hom. de decem mille tal. 3)
And why, then, passing by the others, does He converse with Peter on these things? (John 21:15). He was the chosen one of the Apostles, and the mouth of the disciples, and the leader of the choir. On this account, Paul also went up on a time to see him rather than the others (Galatians 1:18). And withal, to show him that he must thenceforward have confidence, as the denial was done away with, He puts into his hands the presidency over the brethren. And He brings not forward the denial, nor reproches him with what had past, but says, 'If you love me, preside over the brethren, …and the third time He gives him the same injunction, showing what a price He sets the presidency over His own sheep. And if one should say, ‘How then did James receive the throne of Jerusalem?,’ this I would answer that He appointed this man (Peter) teacher, not of that throne, but of the whole world. (Chrysostom, In Joan. Hom. 1xxxviii. n. 1, tom. viii)
In truth we have seen that a manifest successor of the prince of the Apostles presides over the Roman Church. We truly believe that Christ has not deserted the Church here (Constantinople), for assistance from you has been our one and only aid from of old and from the beginning by the providence of God in the critical times. You are, indeed the untroubled and pure fount of orthodoxy from the beginning, you the calm harbor of the whole Church, far removed from the waves of heresy, you the God-chosen city of refuge. (Letter of St. Theodor & Four Abbots to Pope Paschal).