Well, Luther’s dedication to Sola Scriptura was called in to question even back in his day. Erasmus accused Luther of rejecting Rome’s authority to guide Biblical interpretation, under the pretense that no interpretation was necessary, and then turning around and re-interpreting the Bible to his own pleasure.
While I’m not sure Jewish scholars ever out and out advocated for allegorical interpretations of scripture, but they certainly didn’t read, for instance, the Cosmography laid out in Genesis as literal (seeing as by and large it looks like a version of the Sumerian/Akkadian cosmography of a flat earth with a crystal dome or firmament above it). Classical Jews would, of course, known and accepted a round Earth, and would have reinterpreted Genesis as not being an account of the literal shape of the Earth.
And that’s always been the problem. Augustine noted that certain interpretations would, on the face of it, look ludicrous even based on the knowledge that had accumulated by his time:
"Often, a non-Christian knows something about the earth, the heavens, and the other parts of the world, about the motions and orbits of the stars and even their sizes and distances, … and this knowledge he holds with certainty from reason and experience. It is thus offensive and disgraceful for an unbeliever to hear a Christian talk nonsense about such things, claiming that what he is saying is based in Scripture. We should do all we can to avoid such an embarrassing situation, which people see as ignorance in the Christian and laugh to scorn.
The shame is not so much that an ignorant person is laughed at, but rather that people outside the faith believe that we hold such opinions, and thus our teachings are rejected as ignorant and unlearned. If they find a Christian mistaken in a subject that they know well and hear him maintaining his foolish opinions as based on our teachings, how are they going to believe these teachings in matters concerning the resurrection of the dead, the hope of eternal life, and the kingdom of heaven, when they think these teachings are filled with fallacies about facts which they have learnt from experience and reason.
Reckless and presumptuous expounders of Scripture bring about much harm when they are caught in their mischievous false opinions by those not bound by our sacred texts. And even more so when they then try to defend their rash and obviously untrue statements by quoting a shower of words from Scripture and even recite from memory passages which they think will support their case ‘without understanding either what they are saying or what they assert with such assurance.’ (1 Timothy 1:7)"
De Genisi ad litteram