Comment by SkyPuncher

I have such a deep need for something that's just a step above semantic search. These non-frontier models running blazingly fast can solve that.

So many problems simply don't require a full LLM, but more than traditional software. Training a novel model isn't really a compelling argument at most tech startups right now, so you need to find an LLM-native way to do things.