I remember someone once called the Catholic Church the ultimate Hotel California: you can check out any time you like, but you can never leave.
Maybe I shouldn’t be so flippant, but a lapsed Catholic is still a Catholic. The priests I know would be more than willing to hear your concerns. The truth is, the ones I know would stop and listen to a non-Catholic, too. It only needs to be a lost or hurting soul who needs someone to listen. Yes, when he finds that suggestions about availing yourself of the sacraments aren’t going to gain a footing, he might inquire about bringing you back, but even if you don’t want to come back, he will probably be willing to help you sort out a problem that needs pastoral experience in the listener.
If your means allow it, however, it wouldn’t be out of place for a non-parishioner to offer a bit of something to the parish at some point for this sort of thing, should you take up more than a few minutes of his time. This be anonymous or given without any reference for your reasons, an offering to the parish, not a straight fee-for-service, but they do have to pay to keep the lights on.