Yes, I think so, though that was when he was younger and astray during his teens and twenties, if I remember right. He truly converted back to Christianity and was baptized at about 30 years old. And when he returned to the Church at that point it wasn’t just a matter of joining the Church, he truly had a conversion of self, his behavior, his philosophy, his beliefs about God and his relation to the world, etc… He went all in. His work Confessions talks a lot about those years of his life.
Edit: The quote is actually from Confessions. In context, he’s talking about how he was when he was younger, admitting his own failings and attachment to pleasures of the flesh at that time.