Comment by russli1993
1 day ago
You need 64 H200 super-node for inference for kimi k3. You will not do inference locally. What might pop the western hardware bubble is Chinese GPU, memory, networking companies. But even in China, these AI centric hardware is not cheap.
> But even in China, these AI centric hardware is not cheap
Definitely not cheap for individuals, but well within SME territory. There are countless small-town, family-owned businesses that had higher startup costs than a hypothetical Kimi-R-Us, Inc.