Comment by Ey7NFZ3P0nzAe

Yes. Kyutai released an opened model called moshi : https://github.com/kyutai-labs/moshi

There's also llama-omni and a few others. None of them are even close to 4o from an LLM standpoint. But moshi is called a "foundational" model and U'm hopeful it will be enhanced. Also there's not yet support for those on most backends like llamacpp / ollama etc. So I'd say we're in a trough but we'll get there.