Comment by lostmsu

If you are on iOS, try my app Roxy Voice: https://apps.apple.com/app/apple-store/id6737482921?pt=12710...

It comes with LLaMA by default, but you can point it to any compatible endpoint, including self-hosted (I personally use Gemini Flash via AI Studio API key because it is free).