The New Testament was written in Koine Greek, so Greek is very relevant here. In Hebrew, the word for spirit – ‘ruach’ – is also feminine.
I don’t accept a canonized Bible, but I do utilize the books in it along with Gnostic scriptures. Since Gnostic scriptures represent the Gnostic tradition, the language in there is very relevant to me as well. The Gospel of Philip, for example, states: “Some say, ‘Mary conceived by the Holy Spirit.’ They are in error. They do not know what they are saying. When did a woman ever conceive by a woman? Mary is the virgin whom no power defiled.”
The Gospel of the Egyptians states: “Three powers came forth from him; they are the Father, the Mother, and the Son, from the living silence, what came forth from the incorruptible Father. These came forth from the silence of the unknown Father.”
The Gospel of the Hebrews: “Even so did my Mother, the Holy Spirit, take me by one of my hairs and carry me away to Mt. Tabor.”
In the Gospel of Thomas, Jesus says, “My mother gave me a body, but my true Mother (the Holy Spirit) gave me life.”
I think it’s also worthwhile to note that many saints, including Hildegard von Bingen and Julian of Norwich, referred to God as Mother.