Comment by daveguy
9 hours ago
Sorry to burst your bubble:
https://en.wikipedia.org/wiki/Wirth%27s_law
Not exactly the same (it's about power rather than price). But close enough that when you said it, I thought, "oh! there is something like that." There's also more fundamental economics laws at play for supply and demand of a resource / efficiencies at scale / etc. Given our ever increasing demand of compute compared increasing supply (cheaper more powerful compute), I expect the supply will bottleneck before the demand does.
Ah, so you think there’s a point where actually bloat slows because we eventually can’t keep up with demand for compute?
I guess this might be happening with LLMs already