Comment by fragmede

9 days ago

Specifically, GNMT came out in 2016, which is 9 years ago.

GNMT used seq2seq with attention to do translations. GNMT plus some RNN and attention lead to transformers, and here we are today.