Comment by purple_turtle
10 days ago
> LLM is a lookup table which tells you "if the last N tokens were s_1, s_2, ..., s_N, then the following token will be t_1 with probability p_1, t_2 with probability p_2, etc...".
No, LLM is not a lookup table for all possible inputs.
No comments yet
Contribute on Hacker News ↗