The internal model they used to solve the Navier-Stoke's problem was significantly better than the public Astra model, and they also used 10,000 agents.
Astra wasn't even released 3mo ago. It would not be surprising in the slightest that a public model from 3mo would not be capable of solving this problem, but an internal one from current day would be.
my speculation is that they have math-specialized model retrain, so it doesn't need to have all world info in weights, but can focus on math RL training.
Presumably it's mainly the better model, I don't see much evidence of a particularly advanced harness based on the reasoning traces that they provided.
The fact that this is plausible should be deeply disturbing and disqualifying for openAI. The fact that they may prevail and win is a travesty of our failed system.
Disqualifying for what? If you develop a proof you aren’t competing for something, you’re expanding the frontier of knowledge. It’s a binary state of the world, either it’s proven or not. Prevail and win what exactly?
Its a capitalistic issue, not a company/technology issue.
If we would have discovered this breakthrough of LLM/ML on scale in a non capitalistic world, we would all work together advancing it faster than it goes right now for the benefit of humanity.
And I don't live forever (at least for now) i def want to see were this road is heading.
Its a conflict of interest for sure, a cnflict of the future of a lot of humans
I'm going to guess the ability to hold a million individual details in an attention space at once, compared to the typical human capacity for about six or seven
Trillions of dollars might be a bit of an advantage.
Trillions?
Quadrillions?
Probably the model OAI used that is strictly better than whichever SOTA - 3 months model OP used?
Nah.
The model is probably comically big and inefficient but big enough
Finally, size really does matter!
The internal model they used to solve the Navier-Stoke's problem was significantly better than the public Astra model, and they also used 10,000 agents.
Astra wasn't even released 3mo ago. It would not be surprising in the slightest that a public model from 3mo would not be capable of solving this problem, but an internal one from current day would be.
my speculation is that they have math-specialized model retrain, so it doesn't need to have all world info in weights, but can focus on math RL training.
Presumably it's mainly the better model, I don't see much evidence of a particularly advanced harness based on the reasoning traces that they provided.
That’s what I was wondering. Thanks.
They ingested all of his sessions with their SOTA models from a few months ago. ;)
The fact that this is plausible should be deeply disturbing and disqualifying for openAI. The fact that they may prevail and win is a travesty of our failed system.
What does "win" mean? There is no prize for this, and having someone discover a proof benefits us all.
3 replies →
Disqualifying for what? If you develop a proof you aren’t competing for something, you’re expanding the frontier of knowledge. It’s a binary state of the world, either it’s proven or not. Prevail and win what exactly?
3 replies →
Its a capitalistic issue, not a company/technology issue.
If we would have discovered this breakthrough of LLM/ML on scale in a non capitalistic world, we would all work together advancing it faster than it goes right now for the benefit of humanity.
And I don't live forever (at least for now) i def want to see were this road is heading.
Its a conflict of interest for sure, a cnflict of the future of a lot of humans
4 replies →
[flagged]
How do you know all these problems were on the precipice of being solved?
2 replies →
Their internal model is allegedly like 4x as capable as the publicly available ones
I'm going to guess the ability to hold a million individual details in an attention space at once, compared to the typical human capacity for about six or seven