Comment by dchuk
14 hours ago
Just tried both the Omni model and the text only model, both as mlx versions, in lm studio omlx and rapid mlx, none of them could actually fire the model up, kept saying safetensors cant be read (yes I realize Claude should hear this not this thread).
I think mlx-vlm should support both the Audio and the Omni model: https://github.com/Blaizzy/mlx-vlm/ and there should be native MLX exports for both here:
- https://huggingface.co/LiquidAI/LFM3-Audio-2B-MLX-8bit
- https://huggingface.co/LiquidAI/LFM3-Omni-2B-MLX-8bit