← Back to context

Comment by zbentley

4 hours ago

Agree to disagree. I think that the nature of a given instance of a programmatic error as something that, once fixed, means it stays fixed is significant.

I also think that if we’re assessing the likelihood of the entire SDLC producing an error (including programmers, choice of language, tests/linters/sanitizers, discipline, deadlines, and so on) and comparing that to the behavior of a running LLM, we’re both making a category error and also zooming out too far to discover useful insights as to how to make things better.

But I think we’re both clear on those positions and it’s OK if we don’t agree. FWIW I do strongly agree that

> Relying on perfect discipline to secure C memory is functionally as dangerous as relying on prompt engineering to secure an LLM.

…just for different reasons that suggest qualitatively different solutions.