It sounds to me that those who have allowed this are not being “sensitive” enough. Of course, raffle drawings should not be held during Mass. The only argument I can think of in its favor is that it makes it easier to let the winner know. That reason is not good enough. Hold the drawing at the coffee-and-doughnuts klatsch in the social hall after Mass, or hold it in the parish office during the week. If the winner is not present, he can be informed by phone or email.
I cannot decide whether the idea of a raffle drawing during Mass reminds me more of the moneychangers in the Temple or the soldiers gambling for Jesus’ clothes at the foot of the cross.