Comment by tony69
6 hours ago
Example 5: how does a giant LLM that needs million-dollar server racks just to run, replicate itself over the internet?
6 hours ago
Example 5: how does a giant LLM that needs million-dollar server racks just to run, replicate itself over the internet?
We’re not far off from the point where a 30B parameter model could do that and run on not-too-expensive hardware. See recent Qwen releases for example and extrapolate the current rate of progress from there.