You are not bound to receive except once a year, at Easter. That means you can refrain at other times without sin - provided there is no reasonable potential for some kind of scandal.
This used to be the norm until rather recently. It was abnormal for more than just a few people to receive on a Sunday, and rare for someone to communicate at a daily Mass. Daily communicants were almost unheard of.
I believe I’ve heard it said that St. Francis only received Holy Communion 3 times in his whole life (this was before the Easter duty precept). Not sure if this is right, but there is also the story of St. Mary of Egypt, who received only twice in the many years after her conversion.
In general, this is the better vice. Today we have reached a point where maybe 1% of congregants are making any kind of a thanksgiving after Mass, our Communion lines are consistently hundreds of times longer than our confessional lines, no small number of people will wave to their friends after receiving, and some 50% of pew sitters don’t believe in the Real Presence, either out of incredulity or, perhaps more tragically, out of ignorance. Maybe the OP is on to something.
Austere - If you really want to mortify yourself and be humbled, get a director and follow his instructions on reception. That will make it more meritorious as well, because it is under obedience!