Comment by OfflineSergio

This is awesome. People are already talking about use of local models for heavy tasks like llm inference. TTS is very much possible on device without any high end gpu. That's why Ive been working integrating it into a free reader web app with some features more than just getting audio from a text.

https://desktop.with.audio/reader