The only way to drive out a lower passion is by a higher, better passion. I think Thomas Aquinas said that.
That is, in principle, my own stance as well. But it isn’t always easy because, the more materialistic you get, the more addicted you become to lower passions and lusts, and, simultaneously, the less sensitive you are to the things of the spirit. So in a sense you have to fight for your true pleasures. It’s a battle in other words. Still, if you endure long enough, knock long enough at the door, it will be opened for you. It has been opened in my case, so it is possible, regardless how “fallen” you may be.
Also, trying to stay in the present moment is another spiritual tool. Being quiet, being open, and free from unnecessary thought. Prayers help too of course.