The current code doesn't appear very optimized. Running on CPU-only it only uses four threads for example, nowhere close to saturating all my cores.
As a result it's dog slow on CPU only, like 3-4 minutes to produce a 3 second clip, and still significantly less than real-time on my 5090 using only 30% of the GPU.
It’s uncanny good. I prefer it to pocket, but then again pocket is much smaller and for realtime streaming.
Ah right I guess I meant for instant which I assume qwen can't do
Pocket TTS is much smaller: 100M parameters versus 600–1800M.
Ah right so I guess qwen3-tts isn't going to work for cpu-only like pocket TTS can(?)
The current code doesn't appear very optimized. Running on CPU-only it only uses four threads for example, nowhere close to saturating all my cores.
As a result it's dog slow on CPU only, like 3-4 minutes to produce a 3 second clip, and still significantly less than real-time on my 5090 using only 30% of the GPU.