Comment by esafak 20 hours ago They have to know that this could bite them and to ask the question first. 2 comments esafak Reply nixpulvis 20 hours ago I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand. switchbak 16 hours ago If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.
nixpulvis 20 hours ago I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand. switchbak 16 hours ago If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.
switchbak 16 hours ago If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.
I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand.
If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.