If you’re going to make an issue of this, then go up the “chain of command”. Talk to the pastor first. If he doesn’t at least apologize, or if he doesn’t give you the answer you want, then take it to the next level. Keep in mind that by the time you get to talk to the bishop (if it goes that far), the fly season may be well over and it will be a moot point until next year. If the pastor says “NO Communion on the tongue” until further notice, and someone grabs your hand, you can always remain in the pew and make an Act of Spiritual Communion.
FWIW, I clasp my hands together during the Our Father, and anyone standing next to me would have to literally pry my hands apart to be able to hold my hand. And I don’t shake hands with anyone at Mass - ever - so my hands remain as germ-free as possible in case I’m summoned to act as an EMHC.