← Back to context Comment by esafak 1 day ago They have to know that this could bite them and to ask the question first. 2 comments esafak Reply nixpulvis 21 hours ago I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand. switchbak 18 hours ago If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.
nixpulvis 21 hours ago I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand. switchbak 18 hours ago If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.
switchbak 18 hours ago If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.
I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand.
If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.