And God is said to ride in or through the heavens in Psalm 68:33 and looks down from heaven upon the earth in Deuteronomy 26:15 and Psalm 102:19; Psalm 14: 2; and Lamentations 3:50. So the dwelling place is regarded as identical with the physical heavens in the Old Testament in those quotes.
Catholic Encyclopedia has:
That God is not subject to spatial limitations follows from His infinite simplicity; and that He is truly present in every place or thing — that He is omnipresent or ubiquitous — follows from the fact that He is the cause and ground of all reality.
Toner, P. (1909). The Nature and Attributes of God. In The Catholic Encyclopedia. New York: Robert Appleton Company.
newadvent.org/cathen/06612a.htm