Comment by NateEag
19 hours ago
Maybe? Who knows?
Since nobody has any remotely reliable way to understand why an LLM output the text it did, this is not knowable.
19 hours ago
Maybe? Who knows?
Since nobody has any remotely reliable way to understand why an LLM output the text it did, this is not knowable.
> this is not knowable
It may be knowable. We don’t know.
In principle, yes, it may be possible.
At present, we have no idea how to do that, so the answer is still "this is not knowable" in practice.
Perhaps that changes tomorrow, or in a month, or a year from now, but until a theoretically-sound technique for understanding what the weights signify is described and demonstrated to be reliable, my statement remains true.
> so the answer is still "this is not knowable" in practice
No, it’s not. It is unknown. To say it may be unknowable you need a fundamental reason why it may not be knowable.
What lies behind event horizons may be unknowable. We have theoretical reasons to suspect this. What LLMs are doing isn’t well enough understood, theoretically, to even say what is knowable versus unknowable. Just what is known and not.
A method not existing and a method being impossible (or unlikely) to exist are separate concepts. When you say something is unknowable, it should mean it literally cannot be known—route around the question entirely.
Rumsfeld matrix
Separate concept. Whether something is knowable is separate from whether it is known.
Whether God exists is scientifically unknowable. The shape of a black-hole singularity is currently not known.
2 replies →
There are like ten sibling replies with a lot of speculation but I'm pretty sure this is the correct answer. I tend to agree with the other commenter we might know someday but we don't know now.