Comment by miki123211
9 hours ago
> These patterns invalidate every later thinking block:
• [...] Rebuilding the top-level system prompt or tools array between requests in the same conversation.
Many people unknowingly do this (at a high cost to them because of the cache busts), this change will finally force them to stop.
Especially if you're generating your system prompt via a template that can change mid conversation, it's so easy to fall into this trap.
No comments yet
Contribute on Hacker News ↗