There are lots of problems with the ‘official’ Islamic line on the Meccan Ka’aba, and the idea that Abraham [and Ishmael] built it. For one there are also Islamic claims that Adam had a hand in building it, long before even that.
There is also a question of ‘which ka’aba’ - there were numbers of ka’abas that attracted worship and pilgrimage in early times. It is most likely that the Ka’aba in Mecca was a late Muhammad or post-Muhammad erection - that the ka’aba that ‘Muhammad knew and lived near’ was the one at Petra - the qibla’s {direction of prayer] of the foundation remains of the oldest mosques appear to align with Petra - indeed this is the case for around 170 years or so after Muhammad’s supposed death.
Mecca was not on any trading route, and not even a reference on a map until the 9th century. It is/was an arid place, with historically only one arsenic contaminated smallish ‘Zam-Zam’ well, dug by Arab nomads. There could never have been a pre-Islamic Ka’aba there - additionally, archeology has failed to unearth/corroborate Mecca being even a small village, let alone a vibrant town and important centre of worship.
Perhaps that is why Saudi Arabia and the Islamic authorities there are having the whole area cemented over - to avoid more discoveries and ‘embarrassing’ revelations?