The RC priests of today are not the Apostles.
When replacing Judas in Acts 1, the Apostles made it clear it had to be someone who witnessed the Resurrection:
**
Acts 1
20For it is written in the book of Psalms, Let his habitation be desolate, and let no man dwell therein: and his bishoprick let another take.
21Wherefore of these men which have companied with us all the time that the Lord Jesus went in and out among us,
22Beginning from the baptism of John, unto that same day that he was taken up from us, must one be ordained to be a witness with us of his resurrection. **
Paul was also a witness to the Resurrection since Christ appeared to Him directly.
I do not see any specific mention of apostles passing the ability to forgive sins to anyone. Nor do I see evidence of them actually conducting confession.
St. Pacien (c 390 A.D.) proves in his work “Epistles”, 1:7, that this power was not given to the Apostles alone, but was passed on to their successors. He writes, “But perhaps this power was only given to the Apostles? Then to them alone was it permitted to baptise, to them alone was it granted to remove the sins of the world. For all these were ordered to no others but to the Apostles . . . If, therefore, the power to baptise and to confirm has come to the bishops from the Apostles, so too have they the power to bind and to loose.”
He states here the principle by which we know that this power was given to the Church permanently: whatever powers are needed for the Church’s work, even though the words conferring them were necessarily spoken to the Apostles alone, are also given to their successors. The power of forgiveness is obviously necessary for the salvation of men. Our Lord makes it clear that he gave it to the Church that she might continue his work; he introduces its bestowal by saying, “As the Father has sent me, I also send you.”
This power, therefore, is one that the Church must wield for all time, for it is given to her to enable her to accomplish her mission.
It is also at least suggested by our Lord’s words that only priests can forgive sins. It is a judicial power. But no judge can exercise his authority without a definite commission, a commission which in any society is given only to qualified officials.
The Church is a perfect society, with her own officials, and normally these alone can exercise authority in matters concerning the purpose of the society; therefore these alone can validly exercise this juridical power.
“This right is granted only to priests.” "Christ granted this right to his Apostles, and it was transmitted by the Apostles to the priests, " says St. Ambrose (c. 333 - 397 A.D.) in his work De Poenitentia. In these two sentences he sums up for us Christian Tradition and the implication of our Lord’s words.