Physics and mathematics are inseparable. Sometimes physics creates mathematics. Geometry is one example. Calculus is another: it was a creation of the study of motion. Sometimes abstract mathematics created by the human mind finds its way into physics, as the infinite-dimensional spaces found their way into quantum theory, and four-dimensional (differential) geometry found its way into relativity. We can only wonder, as Einstein did, how “mathematics, being after all a product of human thought, [can be] so admirably appropriate to the objects of reality.”
Mathematics is the language of physics, and both ought to be mastered as early as possible, just as language has come to be mastered as early as possible.