Comment by nmfisher
4 hours ago
From my brief window of Fable usage, speed wasn't its strong point at all.
For actually building software, I'm starting to suspect a human with a dumber (but faster) model is going to get the job done quicker than Fable (and possibly even cheaper). Bug-finding and vulnerability detection is a different story.
My conclusion was the exact opposite. Maybe each individual response was slower, but it took so many fewer round trips to get what I wanted wanted. I had a project fable was progressing steadily and correctly on. Opus on the same project keeps handing me garbage it insists is working and meets the stated requirements, but isn’t and doesn’t.
I’d say you tried on an insufficiently complex codebase. I’ve tried on a MLOC+ and the results were excellent compared to anything else.
Not saying the results were bad - quite the opposite. But it was very slow (and if I was paying API rates, hideously expensive).