Comment by nmfisher
6 hours ago
From my brief window of Fable usage, speed wasn't its strong point at all.
For actually building software, I'm starting to suspect a human with a dumber (but faster) model is going to get the job done quicker than Fable (and possibly even cheaper). Bug-finding and vulnerability detection is a different story.
I’d say you tried on an insufficiently complex codebase. I’ve tried on a MLOC+ and the results were excellent compared to anything else.
Not saying the results were bad - quite the opposite. But it was very slow (and if I was paying API rates, hideously expensive).
My conclusion was the exact opposite. Maybe each individual response was slower, but it took so many fewer round trips to get what I wanted wanted. I had a project fable was progressing steadily and correctly on. Opus on the same project keeps handing me garbage it insists is working and meets the stated requirements, but isn’t and doesn’t.