Comment by buu700
2 days ago
I assumed they were describing AI itself as a black box (contrasting it with deterministic code generation), not the output of AI.
2 days ago
I assumed they were describing AI itself as a black box (contrasting it with deterministic code generation), not the output of AI.
Right, I get that, and an LLM call by itself clearly is a black box. I just don't get why that's supposed to matter. It produces an artifact I can (and must) verify myself.
Because if the LLM is a black box and its output must ultimately be verified by humans, then you can't treat conversion of prompts into code as a simple build step as though an AI agent were just some sort of compiler. You still need to persist the actual code in source control.
(I assume that isn't what you're actually arguing against, in which case at least one of us must have misread something from the parent chain.)
Right, you definitely can't do that. People do talk as if the question was whether we could stick LLM calls into Makefiles. Nobody would ever do that, at least not with the technology we have at hand.
3 replies →