Comment by asyncadventure 11 days ago [dead] 2 comments asyncadventure Reply jmuncor 10 days ago That is exactly the idea, later we can actually tap into the middle and optimize how the context is actually being used. Feels like the current anthropic tools like compact don't do a great job at it. teodorasgenova 10 days ago Curious - what pushed you toward a proxy vs adding observability/instrumentation in the code?
jmuncor 10 days ago That is exactly the idea, later we can actually tap into the middle and optimize how the context is actually being used. Feels like the current anthropic tools like compact don't do a great job at it.
teodorasgenova 10 days ago Curious - what pushed you toward a proxy vs adding observability/instrumentation in the code?
That is exactly the idea, later we can actually tap into the middle and optimize how the context is actually being used. Feels like the current anthropic tools like compact don't do a great job at it.
Curious - what pushed you toward a proxy vs adding observability/instrumentation in the code?