Most men want a wife and family. Celibacy precludes marriage and children. That’s a huge percentage of candidates eliminated from the priesthood. Very, very few people have the gift of celibacy. It’s a charism. It cannot be taught.
It is, of course, possible that men and women called to celibacy find greater joy, beauty, and/or purpose living celibately for God, as Jesus Himself mentions in Matthew 19:12, than they do in marriage. I’m not sure a total lack of desire for marriage is required, just that they desire something else more.
I know that I have my own desires that, should I pursue them, would be sinful, but I choose not to because I desire the Church and Christ more. There’s a beauty there that those desires would take away from if I pursue them.
The men that don’t want to marry traditionally would be asexuals (very small percentage of the human population), homosexuals, and those with psychosexual disorders, like pedophiles. By demanding celibacy the Church opened the door to many men entering the priesthood for reasons not related to serving God. The abuse crisis is intrinsically linked to the celibacy requirement.
If that were that simple, we’d see a higher, potentially considerably higher, rate of child sex predators among the priesthood than we would in the general population. That, of course, is not the case. Besides, it isn’t like lifting the requirement of priestly celibacy would stop many of those men from seeking the priesthood, especially since one of those groups is forbidden from marrying.
And I’m not denying that some men entered the priesthood for poor reasons, such as suffering from same sex attraction and thinking that priesthood was their only option. In those cases, though, we don’t have to remove the beauty of priestly celibacy. We need to do better at helping these men find their own beautiful role within the Church.