Do not be afraid!
The Priest, like any person, are not in a position to judge another, or try to demean them, through their own knowledge of your life. Not only is this contrary to what we profess as Catholics, but also blind to our own faults and failures.
In our Parish, we have no Confessional. All confessions are done face-to-face, whether in the small “kitchen” next to the entrance (whose door is kept shut), an empty storage room, the Sacristy or even a remote corner of the Church. As we are a small, tight-knit community, only a couple visit confession when it is available.
As a convert, I am still nervous going to confession, and I know that Father seems to sense that. Often, he will lighten the mood by engaging in some conversation after absolution, regarding how work is, my spirituality and so on.
Our Priests have heard many different confessions during their lives. It should not affect the way they treat you. Don’t be shy of being around him, for fear that he might not be happy with your efforts as a result of confession.
The point is, our Priests are often more aware of humanities’ shortcomings than anyone else. So I doubt they have it in them to be critical directly toward you. They may assign a harsher penance, or perhaps try earnestly to understand what you are battling (much to your embarrassment) - but that is their job.
Again, I want to restate to you: Do not be afraid! God is working through His Minister to help you be forgiven. Rejoice in that, and let it fuel further spiritual growth.
Remember that if the Priest has serious concerns about you, he may deny absolution - I’m not sure how often this may happen, but I doubt you or many others would be in such a state for this to occur.
Hope this helps!

Mike