Comment by UltraSane

I model the chat as a series of prompt and response nodes like

(prompt)-[:NEXT]->(response)

and can choose a given context by using a path query

MATCH p = (:prompt{id:<>})-[:NEXT*]->(:response{id:<>}) RETURN p

and extract the text from the nodes and format it as the API requires.