I will add another thought, which is indirectly related to this. I do not think people realize how (mentally) exhausting saying a Sunday mass can be for a priest. Most priests around here have to do 3 masses on a given Sunday (sometimes 4 counting Saturday night). A friend of mine who was the pastor at our parish talked about this with me once. He said he could handle two masses pretty easily, three is a little tiring, the times when he had to do four is very exhausting. We think its only an an hour or so of “work”, but aa priest has to try to stay mentally focused during that entire hour. On top of that there is the time before hand making sure everything is ready, vesting, dealing with EMHC and altar servers and lectors. Afterwards there is time greeting people, giving blessings to people who walk up and request it, etc, etc. We think, “oh, I can just catch Fr. after mass and talk to him about XYZ”, well there are 20 other people thinking the same thing.
I have no problem with a priest taking a Sunday “off”, typically that means he would be saying at least one mass somewhere at any rate.