Comment by KingMob
9 hours ago
Setting aside that very little about economics rises to the level of "facts of nature" like physics...
What makes you so certain that economies of scale won't work the opposite way you imagine? E.g., if model improvement tapers off, but RAM costs decline (hard to believe atm, but historically likely), then eventually everyone will be able to run SOTA models on their personal hardware.
Heck, even if model sizes simply grow more slowly than RAM costs decrease, the same would happen.
No comments yet
Contribute on Hacker News ↗