Comment by zmgsabst

I’ve found it extremely hard to get LLMs to exit the basin of your current knowledge.

One of my tests for new models is to ask about a concept I already know the mathematical model for, but as if I don’t. So far, they all answer the same way:

1. Convoluted explanations about how it kinda-sorta is common terms.

2. If you follow up with the correct mathematical term, it immediately claims that’s correct and the right way to model it.

3. If you ask it why it didn’t use that term for your question, the LLM gives some version of explaining that it tried to match your language.

I have no choice but to assume the model behaves similarly other times — and that I am largely trapped in a basin of my own ignorance, when using LLMs.