← Back to context

Comment by aix1

6 days ago

Did not trigger for me (Fable answered the question), so I guess the filters are either non-deterministic or are still being tweaked.

Interesting, I assumed all model-routing was done utilizing an LLM. (I.e. non-deterministic.)

  • It’s possible that there’s a set of words or phrases that route deterministically to save money on obvious stuff.

    I kind of wonder, though, which model they’re using to do the routing. It seems like a huge added cost to do these kinds of checks on every request