Comment by naveen99
2 years ago
They just clone it a few times and call it multi head attention. 2 doesn’t really make sense. 3 is the right number.
2 years ago
They just clone it a few times and call it multi head attention. 2 doesn’t really make sense. 3 is the right number.
No comments yet
Contribute on Hacker News ↗