It’s important not to try and build a position on verses in isolation. In the case of Peter’s role and authority, we have not only the verses from Matthew (which are very explicit and not to be passed over lightly) but also, for example, Jesus’ pre- and post-resurrection instructions to Peter (Luke 22 and John 21). We also see John (the best friend) deferring to Peter at the tomb and Peter’s “spokesman” role at Pentecost, the fact that Paul had to be brought to the inner 3 (Peter, James and John) for approval before he could exercise authority in the Church, etc.