Comment by Borealid

I think the most useful word in both cases is "extrapolating".

An LLM extrapolates from its context window to the immediate next token. This word applies whether you view what's happening as "reasoning", "prediction", or as a math function.