But the proto-gospel of James does use hyperbole.
It is even less reliable as a source than Luke is!
One has to be very careful about these things. For instance, scholars had always known that Homer’s Iliad was a fanciful legend, and thereby were completely skeptical of what it said.
Schliemann knew this, but was strongly certain that the legend–myth-story had a basis in truth. He went searching and actually found Troy, to the amazement of the skeptics.
Does that mean every fact related, or every piece of dialog in the Iliad is true? Of course not! What Homer recorded (long after the events) was a piece of historical fiction, we can’t count on the dialogs to be accurate, nor the dates and other facts.
But underlying all of that was the fact that Troy did exist, and it fell by seige more than once. This indicating that whatever flaws the story may contain and whatever fictions were introduced by dramatists later, it began as a retelling of some basic true story.
We cannot know it for sure from this far off in time, but the proto-gospel of James can contain some basic truths under the uncertain details. As a reflection of the common understanding of the second century Christians about the key players: Mary, Joseph, Joachim and Anna it has a much higher probability of being right in the basic facts than any 16th century exercise in polemics.