Comment by navigate8310

No amount of big context window can stop the model from context poisoning. So in a sense, it's a gimmick when you start having the feel of how bad the output is.