Comment by __MatrixMan__

Yeah, if it's a novel prompt, by all means send it to the model, but if its the same prompt as 30s ago, just immediately give me the same response I got 30s ago.

That's typically how we expect bash pipelines to work, right?