We all know that there are many, many poor places around the world, and what you describe is not unusual.
What many Catholics find discouraging and even highly offensive, however, is when architects and their patrons who actually do have money design the ugliness into the structure from the beginning. In other words, they INTEND to design ugliness. They wouldn’t call it ugly, of course, but that is the result all the same.
Here, for example, is the paragon of ugliness, and all it cost is $200 million:
pixelmap.com/dma_moneo_02.html
That church with the dirt floor that you visited is I’m sure far more charming then that hulking monstrosity in Los Angeles.
Why can’t we have both – the Eucharist AND beautiful churches? We used to!