Comment by RugnirViking

I think that's less a math thing and more a rigorous treatment of anything. I find most llms are subject to this type of error where as your conversation context gets longer it becomes dramatically stupider. Heck, try playing chess with it. Once it comes to the midgame it's forgetting which moves it just made, like literally the message previous, hallucinating the context up to that point -- even when providing it the position.