Comment by rurban

No, not yet. Up to a single H100 there is no single local model, which doesn't make your code worse. (excluding trivial stuff like ruby, python, typescript). Implement features, fix bugs.

Right now we started experimenting with 2 H100's, 160GB models. But even a single one is wide out of anyone others league.