Yeah, the reason why I am annoyed by it is because a person (who felt like a burner account of the laya creator) yesterday was haranguing me for saying that projects like this were vibe coded, posting the link to this project.
I evaluated this project yesterday and found its claims un-credible. It's literally nothing like jev. That's some context behind why, a day later, I find it annoying that this is somehow the top story on HN.
I don't really see the breakthrough in Jev. Classification, scoring, routing and returning probabilities over predefined choices are all established problems. We implemented category routing in our own retrieval system in a slightly different way: embed the incoming query, compare it against category profiles and route to the highest cosine-similarity. Obviously Jev isn't similarity based, but the underlying task of making a constrained decision from predefined choices isn't novel. TypeSafe says Jev has a new architecture and RLCD training, but Jev's actual architecture, weights and training details aren't public. So we can't even claim Jev is specifically a BERT classifier, but also don't see enough public technical evidence yet to call the underlying idea a breakthrough. Atleast they should publish a technical paper to prove their idea is breakthrough.
What is jev like? Did they release any research paper? I really think typesafe hired someone to boost their post because there was nothing "Breakthrough" about their product. At least this post has some touch with the reality that this functionality was available a year ago and was well known among ML people.
> At least this post has some touch with the reality that this functionality was available a year ago and was well known among ML people.
When you market a product you make exciting claims relative to the audience you’re engaging with. When was the last time you saw a product marketing page reverently lost all the academic research and prior art that came together to make a product possible?
If Layla’s functionality was available in a SaaS form in a way that could be used by all the people who are excited about and using Jev, wouldn’t this research have won hearts and minds last year when it landed? I would have a lot more empathy for the author if they’d taken a product to market and nobody cared. But even then maybe the market wasn’t ready. There are still reasonable explanations why sometimes ideas take off. We’re on a venture capital forum this shouldn’t need an explanation.
I agree with your analysis based on my own last night (on another HN post to this same gripe on reddit, before this blog post). OP received a lot of echo chamber support in the subreddit, and recommended to post to HN, so here we are.
The work is very amateurish, the "paper" would be a strong reject if I were still peer reviewing.
Yeah, the reason why I am annoyed by it is because a person (who felt like a burner account of the laya creator) yesterday was haranguing me for saying that projects like this were vibe coded, posting the link to this project.
I evaluated this project yesterday and found its claims un-credible. It's literally nothing like jev. That's some context behind why, a day later, I find it annoying that this is somehow the top story on HN.
https://news.ycombinator.com/item?id=49752902
I don't really see the breakthrough in Jev. Classification, scoring, routing and returning probabilities over predefined choices are all established problems. We implemented category routing in our own retrieval system in a slightly different way: embed the incoming query, compare it against category profiles and route to the highest cosine-similarity. Obviously Jev isn't similarity based, but the underlying task of making a constrained decision from predefined choices isn't novel. TypeSafe says Jev has a new architecture and RLCD training, but Jev's actual architecture, weights and training details aren't public. So we can't even claim Jev is specifically a BERT classifier, but also don't see enough public technical evidence yet to call the underlying idea a breakthrough. Atleast they should publish a technical paper to prove their idea is breakthrough.
What is jev like? Did they release any research paper? I really think typesafe hired someone to boost their post because there was nothing "Breakthrough" about their product. At least this post has some touch with the reality that this functionality was available a year ago and was well known among ML people.
> At least this post has some touch with the reality that this functionality was available a year ago and was well known among ML people.
When you market a product you make exciting claims relative to the audience you’re engaging with. When was the last time you saw a product marketing page reverently lost all the academic research and prior art that came together to make a product possible?
If Layla’s functionality was available in a SaaS form in a way that could be used by all the people who are excited about and using Jev, wouldn’t this research have won hearts and minds last year when it landed? I would have a lot more empathy for the author if they’d taken a product to market and nobody cared. But even then maybe the market wasn’t ready. There are still reasonable explanations why sometimes ideas take off. We’re on a venture capital forum this shouldn’t need an explanation.
I can't believe you say in another post that you have experience with bert and yet you don't understand the value of a generalist classifier.
Good models take time and effort. There wasn't a good option for satisficers until a few days ago.
I agree with your analysis based on my own last night (on another HN post to this same gripe on reddit, before this blog post). OP received a lot of echo chamber support in the subreddit, and recommended to post to HN, so here we are.
The work is very amateurish, the "paper" would be a strong reject if I were still peer reviewing.
https://www.reddit.com/r/LocalLLaMA/comments/1wijo3e/i_liter...