I was in Bethlehem several years ago and someone asked our tour guide that very same question. He responded that, according to local tradition, Mary visited Bethlehem after many years of living in Ephesus and she pointed that place out as the place where Jesus was born. Someone asked her how could she be sure after so many years and she said, “Because a mother never forgets where her child was born.”
