Comment by hbrn

But is there any proof that Jev is frontier intelligence?

It thinks there are two Rs in strawberry.

It fails to assign probabilities to die roll outcomes or coin flips.

When used as an LLM it thinks it is Qwen.

Apparently reordering the list of possible answers can change assigned probabilities by up to 20%.

I’ve seen claims that it struggles to play tic tac toe.

So far there is a lot of evidence that it behaves exactly like a tiny open weight model. The only argument against this claim is “trust me bro” claims from it’s author.