Comment by JMKH42

I bet the timing was the key, people in the last year have been furiously building things that use LLMs as an API and as we work on this stuff we have systems with N LLM steps and M of them are frustrating because you want a specific choice picked or list of things ranked and sometimes the llm will just output something else entirely!

So along comes this thing you can graft in that is more reliable, faster, and cheaper for that, and I get it immediately.

A year ago I'd be like "kinda cool but what it for?"