Comment by JumpCrisscross

> so the answer is still "this is not knowable" in practice

No, it’s not. It is unknown. To say it may be unknowable you need a fundamental reason why it may not be knowable.

What lies behind event horizons may be unknowable. We have theoretical reasons to suspect this. What LLMs are doing isn’t well enough understood, theoretically, to even say what is knowable versus unknowable. Just what is known and not.

A method not existing and a method being impossible (or unlikely) to exist are separate concepts. When you say something is unknowable, it should mean it literally cannot be known—route around the question entirely.