Fact and faith have little in common? Maybe from the perspective of those who reject the factual accuracy of things knowable only through faith. For those with divine faith, things known by that faith are known to be objectively true with as much or sometimes more certainty than things knowable through natural means, like reason or the senses.
Moving beyond “fact and faith” to “religion and science” and to the Einstein quote you gave, I guess the idea could be subject to both good and bad interpretations.
A bad interpretation (though it may indeed be what Einstein meant) would be that faith is incapable of bringing a person to true knowledge, while science on its own is incapable of motivating people to live their lives and to strive to learn and invent and accomplish. One thus would need science to inform one’s views of reality, but also something a little irrational or at least arational to go on living in a creative and optimistic way.
A good interpretation would be that faith and reason (and among the things reason can bring us to, empirical science) enrich each other rather than being in any kind of true conflict. Faith confirms the philosophical assumptions empirical science is based on, like the value of human reason and the basic reliability of the senses, and provides a check against some serious errors one may mistakenly fall into through errant science (modern empirical science is a young field after all and deals mostly in probabilities, and anyone with a knowledge of history knows wrong ideas have had periods of popularity). Reason meanwhile helps us better understand ideas we already hold by faith, through things like theology, archeology, biology, etc.