Math is a specialized form of Philosophy. It is of the class of “constructed”, “independent” philsophies dealing with the concepts of what it means “to be” a thing separate from another thing of the same genus.
In english: math is a kind of philosophy constructed by human beings, and one that has no relationship to reality at all, in any way, period.
What physics does is, basically, study God’s creation, and then attempt to describe that creation using either newly constructed maths that express the physicist’s current understanding of said creation, or by re-using maths that already exist that can be applied without serious contradiction.
This introduces the risk of believing the math is the creation, and thus infering what is implied by the math, but not by the reality.
Examples of the gaps between human constructed maths and creation are many, but for the lay person, Einstein did some of the basic work to correct the model created by Newton, et al.
The most obvious examples of math having no relationship to reality are, however, much easier for the layperson to grasp. Look at any “third person shooter” real time video game where the characters are allowed to do things that violate the laws of physics. The mathematical model of the game allows for these actions, thus these actions are logical, correct and reasonable within the model of the game (they are “mathematically valid”), but try them in the real world, and you are toast.
A computer programmer spends inordinate amounts of time trying to get his mathematical models sufficiently coherent with reality as to avoid “crashes”.
A man bent over his checkbook, trying to get it to match the reality of the money in his wallet knows the difference between math and the real world, too.