Comment by numpad0
3 hours ago
There aren't good datasets for that. Even neural TTS for Japanese struggles with it since Japanese transcriptions used to train models don't preserve pronunciations used.
(or maybe it could be theoretically done, just the mechanism to automatically classify wildly different pronunciations mapped to the same literal expressions don't yet exist)
That's surprising. I'd have thought that a multimodal LLM like openai's would "just work", at the very least enough to generate enough data to distill down to a simpler model.