Comment by whatthejesus

None of them is better than the others on the frontier. But to be honest, the models are designed for acing STEM exams not doing copywriting.

This is further evidence of the need for small models doing specific things well.

Where I would say models fit in the process is establishing the general layout of documentation and iteratively refining things out. Interestingly, it’s the same for image generation too. But 9 out of 10 it creates incomplete work that needs refinement.

Go wide, then hone in, refine. There’s no such thing as getting AI to single shot creative tasks. Which is funny because everyone thought writers are on the chopping block initially, but that is unequivocally NOT the case.

Even technical tasks, agents doing it their own way yields garbage in some right. It’s just a question of how long it runs before it goes down a path of no return.

Human in the loop is the only way. And, to be honest, what’s the f*king rush anyway? We all need to slow down. Good ideas with unravel in time. :)