Comment by littlestymaar
10 months ago
Except nobody but groq has such type of machines, and the economics of cloud AI is very hard to make it works in practice. Offloading the capital cost (which is the hardest kind of cost to swallow for a company) to customers is very compelling business-wise.
What they are doing is not very special soon a lot of companies will do it. Lets call it end to end LLM hardware
And they will be in everyone's laptop, because that's pretty much the only economically viable way way to amortize the development cost ;)