Comment by Levitating

10 hours ago

Ideally the model would be run locally in the browser, so the author isn't paying whatever they're paying. But the web standards to do complicated stuff locally aren't there yet and probably will never be.

That's not a practical answer but it's my two cents.

All you need is WASM surely? I expect this model is too big to download & run on local CPUs though.

  • Maybe, but WASM still has its limitations and pains. If you compile with emscripten you're still using thousands lines of generated javascript to glue the wasm and javaecript together.