Comment by throwuxiytayq
5 hours ago
No, it really does take ~0.03s to generate the answer. Try your browser's developer tools and watch the requests.
5 hours ago
No, it really does take ~0.03s to generate the answer. Try your browser's developer tools and watch the requests.
Isn't it crazy that we can send a message, across the world near instantaneously and have a coherent reply, generated by a computer, sent back to your screen, in under 500ms in most circumstances.
I find myself getting caught up in the sheer speed of modern computing and networking. The fact I can play an online game with 10 other people is just insane.
I got into Rust development via LLM last year, and being able to do things budgeted in nanoseconds is a heady feeling indeed. Real time video and audio analysis? Totally doable, plenty of time budget. 16.6ms is a long time, it turns out.