Comment by dzink
21 hours ago
AI without guardrails is an instant complexity creep. The complexity quickly overpowers it and the purpose of the project it was asked to work on. After a very low threshold that complexity becomes unmanageable by humans. At that point you become dependent on AI. The job of professionals now is to contain the complexity to keep projects maintainable and manageable, because even Claude will runaway and outpace itself and not be able to catch up with itself on a larger project. Humans are fully capable of generating spaghetti code too, but nothing can outpace AI in doing it. If you give up thinking you lose control and ownership fast.
My experience is that if unchecked very quickly no useful work is being done and every agent is just checking boxes and telling each other what wonderful bureaucrats they are. I am trying to have comprehensive telemetry and checks that limit the overhead to max 10%. Jokes on me since the telemetry turned out the be the most complex item which will finish last. Well, there is always the next project.