Comment by CSMastermind

10 hours ago

Sol easily outperforms Fable on every task I've tried it on.

That's not my experience and I suspect it's not most people's experience. Out of curiosity, what's the hardest task you tried?

  • For me something the likes of: design a CDM for integrating these 5 logistical systems, with full docs and examples provided for each, as well as modeled transports specific to our business. Prompt was of course much longer.

    Both failed spectacularly. But sol's output at least contained interesting findings and some useful parts, as well as not being 20000 words of unbearable language.

I can't speak for others but I have a feeling you're in the very small minority with this take.

You could say Sol is faster and cheaper and that's true. Outperforms Fable? Impossible to believe without hard evidence.

  • I dont think that feeling is entirely useful.

    Because Claude doesn't allow third party harnesses on their subscriptions I doubt the majority of signals you're getting are actually that significant on pure model quality.

    I suspect you're right on Sol not outperforming Fable; but i've not used Fable that much.

    ---

    But, fwiw, in my custom harness between Sol & Opus 4.8 - then Sol wins by a ridiculous margin as Opus keeps claiming slightly wrong things with certainty much more.