Why should she leave in “as dramatic a way as possible” and thereby probably cause further pain among a parish that has already suffered so much that they would leave their former church home? I don’t think that she should hide what she is doing by any means but this is not good advice.
By leaving after, say, going to the pulpit and announcing that in his opinion the Catholic Church is a better choice than even where they are now, would explicitly send a message to the assembled about his level of conviction.
That is the definition of “evangelization”.
It could (perhaps easily) be delivered in such a way that would be LESS distressing to the parishoners than his simply “quietly disappearing”.
There’s going to be “talk” and “whispers” about what had happened anyway, of course.
Perhaps it would be better to get the “real scoop” out into the open?
It’s really a temperment question. How does the OP feel about dealing with this opportunity to evangelize, and how it looks to the parishoners if he leaves “explicitly” as opposed to “ghostlike”.
*EDIT:
Yes, I am being a bit flippant. Admittedly.
This is NOT my situation, and it costs me nothing to state a possible “solution” to this situation.
I personally would most likely NOT leave in a dramatic manner, as I’m certainly NOT that great a public speaker, and that would be the job of a master speaker.
But,… the “dramatic approach” is a legitimate opportunity for having a DEEP communication with a group of somewhat disillusioned people about their possibilities in faith.
I’ve just tossed it out there as something to consider.
Thanks for your forebearance.

*