Comment by CobrastanJorji
5 hours ago
> Astra for Law passed the evaluation’s overall correctness check on 54.0% of questions.
How is this a product that you are selling?
5 hours ago
> Astra for Law passed the evaluation’s overall correctness check on 54.0% of questions.
How is this a product that you are selling?
On the promise of potential cost savings by means of firing and/or not hiring as much.
Help me understand your consternation.
It’s barely any better than a coin flip
54.0% isn't particularly high.
What I'm trying to say which doesnt seem obvious is that all models are x% correct at benchmarks until they get saturated, and then new benchmarks get made.
waiting for the actual Prodigy Corp. to show up and offer to buy your username out?
<my own consternation, stated>