Comment by jondwillis

The way the API works, is that you construct messages. The messages are strings with some metadata like `type` (in their most basic.) The system prompt is a more or less string that (should) be first in the array of `type: system`.

Unless they are forsaking their API ethos that has become somewhat of a standard, for their own product… when a request comes in, they use a templating library, language string comprehension, or good old fashioned string concatenation with variables, to create a dynamic system prompt. “Today is $(date)” This applies to anything they’d like to reference. The names of tool properties, the current user’s saved memories, the contents of a HTTP GET to hacker news…