← Back to context

Comment by UltraSane

20 hours ago

OpenAI does cache the most frequent questions like this.

There is no way to cache the answer to questions that differ by even one token reliably without introducing potential problems.

  • there absolutely are ways to cache common-routes to fields of commonly requested paths.

    (hint : it's not all regex and checksums.)

    • Ok I'll bite, how do you reuse the answer to "what color is the sky?" while also layering in memory, custom system instructions and custom response styles?

      1 reply →

Doubtful. Considering features like memory, response style, custom system instructions, etc. can heavy alter a users output.