I have been as a guy on both sides of the spectrum
Proor to my ex wife I was at least technically chaste…
After my ex wife I made it 6 yrs of my half butted interest in it (not really a practicing catholic, just a risidual moral value I gues)
Turns out I found women were evil and all, but dang you sure are a pretty bunch and apparently 6 yrs was my limit so being non practicing I endeavored in secular activities
Now once you open those floodgates… dang. Lol
So I would say if you have, yeah you struggle more than the always chaste.
But no more than us who have been on both sides of the fence. In fact my 3rd to last lady was the one who helped set me on the practicing path and when we met she said she was not going to until.
Well we did…and when I said no she said yes and visa versa… failure is a two way street

but I can assure you the comedy when I hear “men will exploit it” eh… sometimes, but women do too.
Honestly I can avoid every other sin… but errrrr one lol