← Back to context Comment by esafak 19 hours ago They have to know that this could bite them and to ask the question first. 2 comments esafak Reply nixpulvis 19 hours ago I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand. switchbak 15 hours ago If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.
nixpulvis 19 hours ago I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand. switchbak 15 hours ago If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.
switchbak 15 hours ago If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.
I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand.
If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.