Comment by onlyrealcuzzo

8 hours ago

This sure looks like a race to the bottom to me, and I love it.

If Sol isn't the best model, it is up there...

You don't cut the price of the best model for no reason...

22 comments

onlyrealcuzzo

Reply
dvt  6 hours ago

> This sure looks like a race to the bottom

Always has been. My prediction is that both OpenAI and Claude will go bust unless they deliver a killer product. And unlike scrappy startups, they have a pretty serious deadline because creditors will come a-knockin'.

There's little to no functional difference between Kimi, Qwen, Sol, Opus, etc. All flagship models are within like 1-5% of each other and the real moat will be what's always been the hard part: making a good product.

  • matheusmoreira  5 hours ago

    > All flagship models are within like 1-5% of each other

    Don't know about that.

    I'm using code review of my lone lisp project as a benchmark. It's a massive parallel code review where a coordinator cuts up the codebase into sections and dispatches agents to consider each part from different perspectives like quality, maintainability, consistency, correctness, rigor, etc.

    Ran a complete Fable/max code review. Took over a month on a subscription. Now I've switched to OpenAI and am repeating the exact same review with Sol/max.

    It's still not done yet but preliminary findings suggest Sol can only reproduce 70-90% of Fable's findings. So I think these models aren't as close as we've been led to believe.

  • roncesvalles  3 hours ago

    The problem is that most of the volume doesn't come from proprietary products, it comes from API use which has no stickiness.

    Claude already has a killer product (claude.ai/chat is a Swiss army knife) but just relying on people typing stuff into chat is not enough to sustain the company.

    The other strategy is entrenching yourself as the LLM of choice into existing products (like ChatGPT is on Apple products).

  • sumedh  3 hours ago

    > All flagship models are within like 1-5% of each other

    Depends on your use case. the Chinese models are not there yet.

  • blfr  4 hours ago

    There is a massive difference even between Opus and Fable, same provider, before various harnesses and other optimizations come into play. Don't be deceived by rankings and benchmarks, try for yourself.