Comment by fwlr
1 day ago
Why should we expect this? Does it help the corporation’s bottom line? How much? Is that worth the R&D spend and compute budget it would need? What advantage do they stand to gain by demystifying their product, that they don’t already get from e.g. Lean verification? Do they gain more if the same research and compute spend on their inscrutable intelligence is directed into making it more intelligent, instead of less inscrutable?
1) Higher-level publicity stunt.
"Our previous version was super-smart, but a bit autistic, even the smartest mathematicians had problems understanding it. The new version is not only super-smart, but can also efficiently communicate its ideas, so that they can be used in real life."
2) Actually, try to use the AI's smarts to gain in real life (not only convincing others to pay you, but actually do the smartest things). Hmmmm, scratch that, that is too idealistic. Use the AI's smarts to become the strongest meanest bastard the others will have no choice but to obey, or else.
Many corporations (their actual customers they're broadcasting to when they say how smart their models are) have requirements (externally imposed, so not something they can just change) that all code is reviewed, so they need it to be understandable, which is basically the same problem.