In what we call the Dark Ages, the church sometimes had trouble getting people to take communion at all; for two reasons if I recall correctly. One was that there was uncertainty as to what to do with the recent convert who confesses and takes communion and then sins again. For a time, at least in some parts, they were considered lost, so communion was saved for what the church member felt was near the end of life.
The other was that among certain converts, eating and drinking the body and blood of Christ was too suggestive of, um, unpleasantness. So the church, in order to get them to do it, ruled they had to come at least once a year for communion in order to remain members of the church.
I don’t know for certain that that is what the current custom of annual minimum dates back to. Others here will know, I’m sure.