Comment by Const-me
10 hours ago
Their previous generation open weight STT model was pretty good.
I have recently launched commercial Windows software implementing offline inference of Voxtral Mini 4B Realtime on commodity hardware: https://vrmac-softver.com/speech2text It requires 4GB VRAM, and exceeds realtime rate on my “median” laptop with Ryzen 5 5600U iGPU. I’m currently working on a Linux port.
I haven't tried Voxtral but I've been really enjoying Parakeet from NVidia.
Been using it to implement a mixed audiobook player + ebook reader that uses Parakeet to sync the narration with its position in the text. Runs fast enough even if CPU-only