← Back to context

Comment by ford

3 days ago

You're better off going directly to artificial analysis, this is a feature-poor/misleading/outdated repackaging

Ex. this type of price estimation is quite naive - some models can require 2-3x the number of tokens to achieve the same level of intelligence. Artificial Analysis' own cost per task is a more fair estimation of cost.

Exactly. The only metric you need to look at is the cost per task and take your pick from the models that match your budget there.

Spark is such a bad model, you are far better off using Astra Medium than using Spark.

Also cache price is crucial, especially for coding tasks (which, really, are where you really start to care the most about unbounded costs)

The analysis might be better on Artifical Analysis' however the way the information is presented by terrydjony is so much better. I'm able to get the exact actionable info I want. Whereas on artificial Analysis I'm analyzing and figuring it out.

It's the equivalent of ai slop writing in a data format.