Comment by greenbeans12

Ooh, good idea. It started as a question: "How do we make this thing the most private?" and the obvious answer was using offline local device LLMs (e.g. Prompt API/Gemini Nano).

Will poke around and see if there's interest here, thank you!