Comment by hbrn

The big problem is that Jev is only useful when you both:

- need fast response

- can tolerate Jev's mediocrity compared to real frontier models

(I explicitly ignore cost, because if you desperately need a cost-optimized classifier you would just build one)

Outside of fun demos these two rarely come together: if it's critical enough to require sub second speed, then it can't be mediocre.

The reason so many OSS models are being built is that Typesafe team made a ton bombastic claims about Jev being a huge breakthrough, and ML folks are realizing they can build Jev-like model in 2 days instead of 2 years.