I’m not sure you’d “have to” take RCIA, but I can’t imagine a better way to approach the faith during the conversion that you are already feeling. At least in my parish, RCIA is more a process than set of classes to check off. It’s a gift of the Church. But, the first step will be to speak to the priest at the parish you plan to attend. The priiest will listen to your discernment story, and recommend the best steps for your own entry into the fullness of the Catholic faith. He may recommend some time in RCIA, and if he does, try not to let it put you off. Go ahead and go. You may be surprised at how beautiful the experience of RCIA can be. I stuck around for 3 years AFTER my confirmation to help out and am getting ready to return as a sponsor now. This is the ordinary process for conversion. In our parish, the person requesting confirmation is interviewed every few weeks to discuss where they are in their journey.
Anyway, I’d let Jesus guide you to him in the Church through his priest, and then follow in eager obedience into the journey at the place where Christ leads you.
May God bless and guide you at each turn,
I will pray for you. Please pray for my ongoing conversion,
Steven