No. Some books which were considered scripture by the early church didn’t ultimately make the Canon. Some disputed writings did.
There’s lots of New testament apocryphal books. I own the M.R.James and J.K. Elliot translations. Some interesting stories actually. It’s interesting because even though most are pseudiographical aka they were written by someone claiming to be someone they weren’t such as an Apostle, you still do get a picture of what the early Church may have thought of as traditions . But no. The formal New Testament wasn’t created until the mid to late fourth century and mainly was a reaction to thwart heresies which Arianism had really been a scare. The Church had some councils, I’m sure heated ones at that, to decide which books were inspired and which weren’t.Before that there was a general consensus but say the Muratoroan Fragment which is a list of scripture from the end of the second century, contains most books we have now but is missing a few such as the epistles of Peter and also James I believe and adds the Shepherd of Hermas and the Apocalypse of Peter as well.
They are interesting reads. Obviously I recommend the Canon books to read first but if you have time and are strong in faith because some of these texts can confuse people especially the Gnostic stuff, but it is some interesting stuff.