Comment by shostack

1 hour ago

I have built out something similar that let's me use my phone's hardware buttons to open an input stream with the mic for my Hermes agent over my matrix gateway and then has it play back with a local TTS model on my Pixel 10 Pro.

But the Deepseek v4 flash model I am using through OpenRouter is killing me on latency. Any suggestions to improve that?