This is no different than a bilingual mass. I’ve often attended Ordinary Form masses where most of the mass was sung / said in English, but the Gloria, Agnus Dei, and perhaps a few other parts of the ordinary were sung in Latin.
As OraLabora pointed out, just make sure you’re using approved liturgical translations otherwise it ceases to be the liturgy of the Church and becomes a private devotion.
Nothing wrong with a private devotion, but it can never have the same merit as the Liturgy.