Comment by BoorishBears
1 day ago
Maybe instead of screaming you can take this as a chance to level up your engineering.
Good engineers don't treat approach as A == B or even A like B, when extremely integral parts of their applications differ.
Zero-shot isn't just "more convenient", in a low data regime: it's the only workable solution, and 100x so if your plan involves the acornym "BERT" (because even the largest of those models has the world knowledge of a fart to draw priors from)
Better ergonomics while being faster and cheaper as the existing things really is enough to justify callling what you've done a new thing, in a world of finite resources and time. It's actually making me scream how many people don't get that.
> in a low data regime: it's the only workable solution
Low data regimes no longer exist in the age of LLMs, one can trivially generate a training and eval set and distill a good classifier on any domain within a day.
But I do acknowledge zero-shot is more convenient. Personally I don't think Jev has any moat so I won't bother with their model specifically, but yes I do anticipate using this type of thing more in the future.
> one can trivially generate a training and eval set and distill a good classifier on any domain within a day.
This might be possible, but it’s not ‘trivial’. Even getting my favorite agent to do it would involve a lot choices about what to tell the agent to do, and a bunch of testing.
With Jev, I can just write my questions and get an answer - or get an agent to write code that generates questions and gets answers. The answers are pretty good! And the whole thing is pretty trivial to understand (where ‘trivial’ here is an order of magnitude more ‘trivial’ than in your comment).
I don't think jev has any moat either, but interestingly the distillation you described sounds like something imo someone would pay for. Convenience again. Personally I wouldn't. I suppose that just makes it a commodity.
> Low data regimes no longer exist in the age of LLMs, one can trivially generate a training and eval set and distill a good classifier on any domain within a day.
They do exist and you can't easily generate them. Distilling is also pointless.
I'm going to crash out at the stupidity and earth-shattering banality of that first paragraph if I try to respond faithfully, so I won't and agree to disagree.
I don't think you actually know what the word 'banal' means, which is quite amusing given your condescension.
1 reply →
> Maybe instead of screaming you can take this as a chance to level up your engineering.
Probably also sales. System One thinking and other buzzwords will help.