Comment by cyanydeez

15 hours ago

they all operate on the same assumption, that a single token has a single meaning and that meaning doesn't change as more information is added. So regardless of size, context poisoning is a near certainty approaching 1 as the context grows. Few tasks are so clinical that they include zero ambiguity in the context chain.