Comment by mewse-hn
4 hours ago
testing it against parakeet right now for ASR, it's slower, heavier, and has a higher error rate. but i'm doing a pass with the embedded translation to see if that's any good, it might be worth it.
e: also i'm testing it with a Q4 quant that might not be full accuracy
ugh, translation is worse than passing a parakeet transcript to a cloud llm. disappointing model.
tried running it against a full anime episode, both vocal isolated and raw. it got confused by english words in the theme song and failed spectacularly three times