Comment by rugina
1 year ago
I think NM translation was broken all along. Not in the neural network part but in choosing the right answer. https://aclanthology.org/2020.coling-main.398.pdf
1 year ago
I think NM translation was broken all along. Not in the neural network part but in choosing the right answer. https://aclanthology.org/2020.coling-main.398.pdf
Since LLMs are loosely based on NM models, it seems research on newer sampling methods like Mirostat might help here.
[dead]