Comment by guelo
4 hours ago
A 10M window would require dozens of GPUs (or TPUs) dedicated to each query. That is something that Google could afford internally but wouldn't be able to scale to an external product.
4 hours ago
A 10M window would require dozens of GPUs (or TPUs) dedicated to each query. That is something that Google could afford internally but wouldn't be able to scale to an external product.
More like one huge waferscaler such as Cerebras.