Comment by howunfortunate
1 day ago
> in a low data regime: it's the only workable solution
Low data regimes no longer exist in the age of LLMs, one can trivially generate a training and eval set and distill a good classifier on any domain within a day.
But I do acknowledge zero-shot is more convenient. Personally I don't think Jev has any moat so I won't bother with their model specifically, but yes I do anticipate using this type of thing more in the future.
> one can trivially generate a training and eval set and distill a good classifier on any domain within a day.
This might be possible, but it’s not ‘trivial’. Even getting my favorite agent to do it would involve a lot choices about what to tell the agent to do, and a bunch of testing.
With Jev, I can just write my questions and get an answer - or get an agent to write code that generates questions and gets answers. The answers are pretty good! And the whole thing is pretty trivial to understand (where ‘trivial’ here is an order of magnitude more ‘trivial’ than in your comment).
I don't think jev has any moat either, but interestingly the distillation you described sounds like something imo someone would pay for. Convenience again. Personally I wouldn't. I suppose that just makes it a commodity.
> Low data regimes no longer exist in the age of LLMs, one can trivially generate a training and eval set and distill a good classifier on any domain within a day.
They do exist and you can't easily generate them. Distilling is also pointless.
I'm going to crash out at the stupidity and earth-shattering banality of that first paragraph if I try to respond faithfully, so I won't and agree to disagree.
I don't think you actually know what the word 'banal' means, which is quite amusing given your condescension.
I'm going to think you believe you're the first person to claim synthetic data replaces data.
You worded it as if it was some pithy gotcha, and I'm sure "lOw dAtA rEgiMeSs doNt eXist aNymOre" would have done numbers on LinkedIn, so maybe you thought it was new.
But no, it's right up there with "the cost of software is zero" and "saas is dead"
Refrains of the clueless grifter who deserves all the condescension one can muster.