The criteria is to confess any grave sins we know to have on our souls before receiving the Eucharist. The Catechism can give some good guidance on which sins are grave. The other two criteria for mortal guilt are full knowledge, and full consent of the will and not knowing you I cannot say whether or not you meet these subjective criteria. However the gravity of a sin is an objective criterion and it is an excellent idea to confess them. If it turns out that your confessor says your culpability is not mortal because of extenuating factors (habit, addiction, etc. can mess with our ability to give full consent to gravely sinful acts) and he says it is not necessary to confess this sin each time it happens, then follow his advice. He is trying to help you avoid falling into scrupulosity which then leads to hopelessness and loss of faith, a favourite trick of the wily one.
It sounds like, in addition to a regular confessor, you’d benefit from a spiritual director.