If I understand you correctly, you are worried about other people sinning because they are judging why you are not receiving communion? First of all, as others said, don’t worry about it. Catholics should be taught at a very young age to never question or make any assumption as to why someone doesn’t go to communion. Secondly, it seems you will be just as noticeable if you approach and receive a blessing as if you stay in your pew. So I don’t get how one action could tempt others to judge you and not the other (at least in any significant way that would tilt the scale one way or the other).
In general, there is no need to receive an individual blessing during communion, we all receive a blessing at the end of mass. Any blessing given other than the priest or deacon is likely not efficacious, so if there is a EMHC in your line it makes little difference. Also, be aware that some priests do not like the practice, although they will seldom make a big deal out of it and just give you the blessing as expected. In general, I would say just stay in your pew.
Having said that, there is one difference that is not insignificant in favor of the practice: no one has to climb over you while you stay in your pew. Now this can be taken care of by being courteous and getting up and stepping out of the pew while others exit and reenter the pew.