Comment by jgalt212

10 hours ago

> as input tokens that are already in the KV cache are practically free for the provider,

not at today's RAM prices.