For something to be a sacrilege there has to be intent. The way that you’re explaining it sounds more like anxiety on your part, not intent to withhold something.
Just go back to confession and get it over with. You can even tell Father what happened the last time. He may need to hear how his behavior distresses the penitent…
I wouldn’t tell him “It’s all your fault.” That would not be kind. But you can say, “I wanted to say this at the last minute, but was afraid that you might be annoyed if I back tracked” or something similar. Don’t lie to him, just explain it in a way that gives him the complete picture. He can’t advise you for the future, if he does not have a good picture.
People often complain that the confessor does not give them the counsel that they need. I often wonder if the confessor has a clear picture.
One more piece of advice. If you’re going to confession and the confessor looks annoyed, just say what you have to say. Father is a big boy and he’ll get over it . . .IF he’s really annoyed.
If he doesn’t want to be annoyed in the confessional, he should join a monastery where he will never have to hear confessions again.
Fraternally,
Br. JR, OSF