I had similar thoughts to yours during my own discernment. My best advice is to find a spiritual director (not just in confession–ask a priest you trust about spiritual direction; he will explain to you what that is) to guide you in your discernment. If you are familiar with priests of the Fraternity of St. Peter or the Institute of Christ the King, I highly recommend them.
Those who go to the seminary do not do so because they aren’t attracted to women. Your desire to be married is natural, and all men experience it to some degree or another (except, perhaps, by a special grace of God); it doesn’t mean you necessarily are called to be married. As you said, it is better not to touch a woman, and the priestly or religious vocation is a greater vocation than marriage (though only, of course, if one is actually called to it by God). While you are in a good state (because it is ridiculous to “date” before you have a prospect actually to be married) being free from intimate relationships with women, I highly encourage you to continue as you are until you’ve thoroughly discerned your vocation. This is your first duty towards God. Without doing this, you will constantly hear in your ear the admonition of St. Augustine: Bene curres sed extra viam (You run well but out of the way).
If you do not seriously discern your vocation, you will be at risk of losing your soul, for if we err in this one choice, everything we do will be wrong. We can do 1,000 acts of charity and spend all our time in prayer, but if we do it not according to God’s will, it is worthless. It is rather a heap of burning coals upon our head. I encourage you, then, to spend time in prayer discerning this–quite, meditative prayer (there is a thread in the Traditionalist forum right now about this topic, if you are unfamiliar with it). Speak to a priest knowledgeable in the ways of God, and he will guide you. One thing I can tell you for sure. It is never, never a mistake to go to the seminary if you go in good will. Whether you stay or leave, it is always worth the effort. You will grow immeasurably more than you can ever imagine in every way. One person mentioned college. If you think you have a vocation, don’t go to college. You will almost certainly lose your vocation. You can learn anything you learn that is worthwhile in college while at the seminary. I will keep your discernment in my prayers. God bless.