← Back to context

Comment by HarHarVeryFunny

10 hours ago

The name "Engram" (n-gram) says it all - this is just another type of statistical word association, not a factual knowledge store.

While DeepSeek describe this as "knowledge lookup", what Engram is really trying to do is separate dynamic reasoning from static pattern recall, with the static patterns just being word-level n-gram statistics, not declarative facts/knowledge.

Just because 2-3 words often appear together in a sequence doesn't mean they represent a fact or truth (or falsehood) - it is just an n-gram statistical regularity.

If Engram helps reduce LLM GPU memory and FLOP requirements then that is great, but it's not a solution for Hallucination.