Comment by siquick

First up - awesome work.

Having been through the year long build of a similar app for another health condition here’s some thoughts focusing on the GenAI side of things:

- What’s the source of the responses? Is this a RAG system or straight-to-LLM?? We have an ever-growing huge repo of domain expert written content which is the source for our RAG system. It’s far easier to control potential misinformation with a well set up RAG and some tight prompting/guardrails.

- What verification do you have that the responses are correct? We have a group of 50 highly experienced experts in the field who constantly vet the responses to our synthetic set questions and it was eye opening how often our “looks good to me” analysis was off at the beginning.

- The main reason for this questions was that your responses are going to be wrong sometimes, what legal protection do you have? Disclaimers, terms of use at absolute minimum. Who is liable if the answer is wrong? Just presume someone is going to be very upset if your response gives them bunk info.

Either way - great work.