I suppose it is fine as long as it did not cause you to commit a sin, or make the other fellow more likely to commit a sin. By the way, not everything about sex is a sin. “In the image of God he created them; male and female he created them.”
Without some specifics, it may be impossible for me or other readers to say more. Here are a few examples: If it was a personal remark against the reputation of another person, there is certainly a possibility of serious sin. If the remark was disrespectful toward a particular class of persons, or if the remark tends to degrade the dignity of human relations or humanity in general, that could be sinful. If it was a figure of speech, for example, speaking metaphorically of a man’s courage as (how to say it delicately?) large or strong anatomical features, that kind of talk, in my opinion, can be acceptable between men, but not in polite company or in dignified settings.