Comment by 23rf
2 months ago
Right.. and computers were once the size of a large room vs now fit into a pocket.
" The reason LLM seems to have stalled a bit is because there just not enough compute."
lol okay mate.
2 months ago
Right.. and computers were once the size of a large room vs now fit into a pocket.
" The reason LLM seems to have stalled a bit is because there just not enough compute."
lol okay mate.
https://x.ai/news/anthropic-compute-partnership
There is literally not enough compute dude. If we had infinite compute we would see everyone building Mythos size models.
"Right.. and computers were once the size of a large room vs now fit into a pocket."
Yeah because we offload much of the compute to off device. You think we would have these small computers in our pockets if the internet didn't exist?
> Right.. and computers were once the size of a large room vs now fit into a pocket.
and yet now we have far bigger rooms with far bigger computers anyway
Hardware may improve exponentially, but demand for compute increases double-exponentially. we'll always need more, bigger computers