Your opinion, is that of Evangelical James Dobson, and has been highly criticized by Catholics. Even without lust it spills the seed without its procreative function which is sinful. Just like Catholics cannot do that when having intercourse.
In Catholic teaching, sex is primarily a giving to another person rather than a pleasuring of self that masturbation is.
CCC teaches clearly.
2352 By masturbation is to be understood the deliberate stimulation of the genital organs in order to derive sexual pleasure. "Both the Magisterium of the Church, in the course of a constant tradition, and the moral sense of the faithful have been in no doubt and have firmly maintained that masturbation is an intrinsically and gravely disordered action."138 “The deliberate use of the sexual faculty, for whatever reason, outside of marriage is essentially contrary to its purpose.” For here sexual pleasure is sought outside of "the sexual relationship which is demanded by the moral order and in which the total meaning of mutual self-giving and human procreation in the context of true love is achieved."139
To form an equitable judgment about the subjects’ moral responsibility and to guide pastoral action, one must take into account the affective immaturity, force of acquired habit, conditions of anxiety or other psychological or social factors that lessen, if not even reduce to a minimum, moral culpability.