← Back to context Comment by attemptone 6 days ago We were talking about linear improvements and I have yet to see it 3 comments attemptone Reply mountainriver 6 days ago check the benchmarks or make one of your own attemptone 5 days ago I checked the BlEU-Score and Perplexity of popular models and both have stagnated around 2021. As a disclaimer this was a cursory check and I didn't dive into the details of how individuals scores were evaluated. mountainriver 5 days ago on what benchmarks? pretty much every major one is linear improvement
mountainriver 6 days ago check the benchmarks or make one of your own attemptone 5 days ago I checked the BlEU-Score and Perplexity of popular models and both have stagnated around 2021. As a disclaimer this was a cursory check and I didn't dive into the details of how individuals scores were evaluated. mountainriver 5 days ago on what benchmarks? pretty much every major one is linear improvement
attemptone 5 days ago I checked the BlEU-Score and Perplexity of popular models and both have stagnated around 2021. As a disclaimer this was a cursory check and I didn't dive into the details of how individuals scores were evaluated. mountainriver 5 days ago on what benchmarks? pretty much every major one is linear improvement
check the benchmarks or make one of your own
I checked the BlEU-Score and Perplexity of popular models and both have stagnated around 2021. As a disclaimer this was a cursory check and I didn't dive into the details of how individuals scores were evaluated.
on what benchmarks? pretty much every major one is linear improvement