Comment by foobar10000
14 hours ago
So, this especially bites if your validation step (let’s say integration tests) take 1hr plus. The harness is just waiting, prefix caching should happily resume things with just a minor new prefill chunk of output from the harness, and bam - completely new prefill.
No comments yet
Contribute on Hacker News ↗