The ECF’s are the histroical witness to the primacy of Peter and those who succeeded him(all before 300 a.d.)
from
newadvent.org
The passage receives an admirable comment from St. Chrysostom:
He saith to him, “Feed my sheep”. Why does He pass over the others and speak of the sheep to Peter? He was the chosen one of the Apostles, the mouth of the disciples, the head of the choir. For this reason Paul went up to see him rather than the others. And also to show him that he must have confidence now that his denial had been purged away. He entrusts him with the rule [prostasia] over the brethren. . . . If anyone should say **“Why then was it James who received the See of Jerusalem?”, I should reply that He made Peter the teacher not of that see but of the whole world. **
[St. John Chrysostom, Homily 88 on John, 1. Cf. Origen, “In Ep. ad Rom.”, 5:10; Ephraem Syrus “Hymn. in B. Petr.” in “Bibl. Orient. Assemani”, 1:95; Leo I, “Serm. iv de natal.”, 2].
St. Cyprian
In the middle of the third century St. Cyprian expressly terms the Roman See the Chair of St. Peter, saying that Cornelius has succeeded to “the place of Fabian which is the place of Peter” (Epistle 51:8; cf. 75:3).
Firmilian of Caesarea
**Firmilian of Caesarea notices that Stephen claimed to decide the controversy regarding rebaptism on the ground that he held the succession from Peter (Cyprian, Epistle 75:17). He does not deny the claim: yet certainly, had he been able, he would have done so. Thus in 250 the Roman episcopate of Peter was admitted by those best able to know the truth, not merely at Rome but in the churches of Africa and of Asia Minor. **
Tertullian
In the first quarter of the century (about 220) Tertullian (On Modesty 21) mentions Callistus’s claim that Peter’s power to forgive sins had descended in a special manner to him. Had the Roman Church been merely founded by Peter and not reckoned him as its first bishop, there could have been no ground for such a contention. Tertullian, like Firmilian, had every motive to deny the claim. Moreover, he had himself resided at Rome, and would have been well aware if the idea of a Roman episcopate of Peter had been, as is contended by its opponents, a novelty dating from the first years of the third century, supplanting the older tradition according to which Peter and Paul were co-founders, and Linus first bishop.
St. Clement
The first witness is St. Clement, a disciple of the Apostles, who, after Linus and Anacletus, succeeded St. Peter as the fourth in the list of popes. In his “Epistle to the Corinthians”, written in 95 or 96, he bids them receive back the bishops whom a turbulent faction among them had expelled.
“If any man”, he says, “should be disobedient unto the words spoken by God through us, let them understand that they will entangle themselves in no slight transgression and danger” (Ep. 59). Moreover, he bids them “render obedience unto the things written by us through the Holy Spirit”. The tone of authority which inspires the latter appears so clearly that Lightfoot did not hesitate to speak of it as “the first step towards papal domination” (Clement 1:70). Thus, at the very commencement of church history, before the last survivor of the Apostles had passed away, we find a Bishop of Rome, himself a disciple of St. Peter, intervening in the affairs of another Church and claiming to settle the matter by a decision spoken under the influence of the Holy Spirit. Such a fact admits of one explanation alone. It is that in the days when the Apostolic teaching was yet fresh in men’s minds the universal Church recognized in the Bishop of Rome the office of supreme head.
Ignatius-letter to the Romans(c 107)
Ignatius, who is also called Theophorus,
to the Church which has obtained mercy, through the majesty of the Most High Father, and Jesus Christ, His only-begotten Son; the Church which is beloved and enlightened by the will of Him that wills all things which are according to the love of Jesus Christ our God,
which also presides in the place of the region of the Romans, worthy of God, worthy of honour, worthy of the highest happiness, worthy of praise, worthy of obtaining her every desire, worthy of being deemed holy, and which presides over love, is named from Christ, and from the Father, which I also salute in the name of Jesus Christ, the Son of the Father: to those who are united, both according to the flesh and spirit, to every one of His commandments; who are filled inseparably with the grace of God, and are purified from every strange taint, * abundance of happiness unblameably, in Jesus Christ our God.*