Perhaps what your priest was trying to say is that though chastity is something very noble for which to strive, merely aiming for chastity (apart from love) is rather like “putting the cart before the horse,” and doomed for failure. This is because the sexual impulse in human beings is the strongest drive that there is, and without true love, is very, very difficult to resist.
When we lust or commit any kind of impure act with another (sins against chastity), we are actually devaluing ourselves and the other person. We are in effect treating ourselves in such a way that is unworthy of the purpose for which we were made–in other words we are failing to love ourselves as God loves us; and we are treating the other as an object for personal gratification, in a word, failing to truly love that person as someone made in God’s image, and as such, worthy of honor, dignity and even a kind of awe.
Contrarily, if we focus on seeing others as God sees them, and we truly love them as He does, we will value them supremely and chastity will be the fruit, it will be the result of seeing others through eyes that truly love.
Romans 13:10 “Love does no harm to its neighbor. Therefore love is the fulfillment of the law.”
Peace to you