Actually, even more than that. The only things God can’t do are those things which violate his nature, including the evil and the unreasonable. Unreason includes things which are contradictions in terms, like creating a square without right angles. By definition a square has right angles, so anything that doesn’t can’t be a square.
So in a sense, mathematical limits do exist in the mind of God–not even God can divide by 0, because that’s impossible under the rules of logic. In another sense, of course, because mathematical limits do really exist in some way, they would have to have some presence in the mind of God, or else they couldn’t exist.