I wouldn’t be too hard on what you read, as this is a theological question not one of infallible church teaching. Another questions to consider were: Was there only 3 Magi or many? The Psalms would lead one to believe many (caravans of dromedaries for the east). But they also tell us of Gold, Frankincense, and Myrrh, and perhaps Matthew took literary license to present only 3 Magi…and through this the Tradition comes where we have names of the “three wise men”…even Matthew presents the Magi as astrologers, and doesn’t discuss the fact that they were a priestly caste of eastern Gentiles who served their king…and again, because of the Psalms we hear of “three kings of the orient” in reference to the Magi.
So to attempt to take the event presented by Matthew in the Literal Sense, without considering the Scriptural Sense (See CCC 115-117), might not give a true picture of the importance of the visitation of the Magi.
Peace.