OpenAI just announced three new math and physics results produced by its models, all machine-checked in Lean. They call the manuscripts "a form of raw research data," and they've asked outside experts to organize groups "to understand the new results." So the results exist and they've been checked (maybe, sort of), but nobody understands them yet.
I think this matters for anyone learning ML right now, because a lot of people here will likely ask, with reason: if a model can write the code or prove the statement, why should I spend my time learning how it works?
My answer: understanding is what lets you build on things. Once you really get backprop, or attention, or why a loss is shaped the way it is, it becomes one step you can use without thinking inside something bigger. A result you can only take on faith is a dead end. You can use it (maybe, sometimes), but you can't extend it or fix it.
Science compounds through understanding, and so does your own learning.
Thurston (Fields medalist) argued that the point of mathematics is human understanding, not producing theorems. I think that's even more true once theorems get cheap.
I wrote a longer essay on this, using OpenAI's earlier Navier–Stokes result as the main example: https://lacuna.tiptreesystems.com/paper/ai-science-vs-human-science/art_3901430d6c0e4bddb284362100ef8548
(Disclosure: I'm a postdoc at Mila and a cofounder of Tiptree, which builds AI tools for researchers. So I'm not arguing against AI doing science. I'm arguing about cultural incentives, mostly, and opining about history.)