Comment by rurban

15 hours ago

You can buy such a PC off from ebay for only €150.000. We did.

But the architecture is similar to kimi's mixture of experts, and we already have such an optimization for different experts swapped in from disc by antirez.