Comment by abustamam
20 days ago
We know _how_ it works but even Anthropic routinely does research on its own models and gets surprised
> We were often surprised by what we saw in the model
https://www.anthropic.com/research/tracing-thoughts-language...
Which is…true of all technologies since forever
Except it's not. Traditional algorithms are well understood because they're deterministic formulas. We know what the output is if we know the input. The surprises that happen with traditional algorithms are when they're applied in non-traditional scenarios as an experiment.
Whereas with LLMs, we get surprised even when using them in an expected way. This is why so much research happens investigating how these models work even after they've been released to the public. And it's also why prompt engineering can feel like black magic.
I don’t know what to tell you other than to say that the concept of determinism in engineering is extremely new
Everything you said right now holds equally true for chemical engineering and biomedical engineering so like you need get some experience
7 replies →