Comment by aDyslecticCrow

> Ergonomics, cost profile, and ease of use are new.

Following AI from the academic papers side; jev really feels silly. They one-pass the LLM tranformer stack and tune the output network for a probability value.

(some clever pararellization optimisations to make it viable to offer as an api, since the normal kv cashing no longer works if you oneshot the tranformer)

The largest change is the packaging; An api with a tolken based pricing, and a schema to define the output structure for quick setup.

Previous projects would probably involve installing pytorch, running a converter script on Qwen, and write a fair bit of matrix math to change the output shape.

I'm kinda amused that it took this long though.