Comment by low_tech_punk

2 days ago

Maybe Google is adding compute infra. I noticed today that the API has 500 tok/s throughput. It's quite compelling now.

0 comments