Comment by sailingparrot
6 hours ago
Well yes, If you magically found a way to reduce a models energy usage by 50%, the thing that would happen immediately after is a doubling of a training scale and of the test time compute assigned for a given budget. I don’t see how that wouldn’t be considered pushing the frontier. Given that scaling is the one thing that has been bringing us closer and closer to AGI, a sudden 2x increase in scaling laws would definitely not be considered pacing. You seem to see a contradiction where I don’t.
Again, absurdly obnoxious, you could frame them giving an employee a shorter walk to their desk as "pushing the frontier".
what's absolutely obnoxious is not being able to have a normal discussion, where we don't need to resolve to useless strawmen that are a loss of time for everyone.
No, releasing a model that has ~3-6x the performance/cost ratio than your last release just 3 weeks ago is not the same as making one employee 0.001% more productive, but you knew that already.
No one said they can't push the frontier, it's pacing the frontier, which mean very different things.
the 5.0 name means its the same model, they made it more efficient and less horrible to talk to. The top frontier people are all still talking to fable 5.1 or models not released to the general public, yet you want to claim this is pushing the frontier, instead of evening the playing field. I state power efficiency gains for existing models and you also claim thats pushing the frontier . It as hell takes a lot to get you to say they AREN'T pushing the frontier, which is why i resorted to the extreme strawman of desk location, because it doesn't seem they are allowed to do anything otherwise.