Comment by sailingparrot
5 hours ago
Well yes, If you magically found a way to reduce a models energy usage by 50%, the thing that would happen immediately after is a doubling of a training scale and of the test time compute assigned for a given budget. I don’t see how that wouldn’t be considered pushing the frontier. Given that scaling is the one thing that has been bringing us closer and closer to AGI, a sudden 2x increase in scaling laws would definitely not be considered pacing. You seem to see a contradiction where I don’t.
Again, absurdly obnoxious, you could frame them giving an employee a shorter walk to their desk as "pushing the frontier".
what's absolutely obnoxious is not being able to have a normal discussion, where we don't need to resolve to useless strawmen that are a loss of time for everyone.
No, releasing a model that has ~3-6x the performance/cost ratio than your last release just 3 weeks ago is not the same as making one employee 0.001% more productive, but you knew that already.
No one said they can't push the frontier, it's pacing the frontier, which mean very different things.