Comment by criley2
16 minutes ago
Are you insinuating that your agents are more effective at 20 tok/s than 200 tok/s?
I don't even understand your analogy. I'm not watching the youtube video or reading the book. The model is. And a big computer can watch 20 youtube videos faster than a small computer can watch 1, and do a far better job understanding all of them (bigger model at data center scale is both smarter and faster than smaller model at local scale).
No comments yet
Contribute on Hacker News ↗