Comment by christophilus
4 hours ago
Wow. This is absolutely wild. I didn't expect that.
If we get to anywhere near this speed for the equivalent of the current models... I don't even know what to think about that future.
4 hours ago
Wow. This is absolutely wild. I didn't expect that.
If we get to anywhere near this speed for the equivalent of the current models... I don't even know what to think about that future.
Speed is the metric I'm currently most interested in. The models are smart enough.
Once speed significantly increases I think we're going to see some interesting downstream effects. The three things I currently spend the most time waiting on are LLM API requests, Rust compile times, and nix derivations. As AI latency approaches zero I think we're going to start taking a hard look at whether slow-compiling languages are adding enough value over Golang, Typescript, or even dynamic languages to be worth the slowdown.
what do you mean "if"? of course we will, and the models will be smarter as well