Comment by blackeyeblitzar
1 year ago
The popular transformer paper, which went on to be used in things like ChatGPT, was authored by Google employees. But “come out of Google” is giving the organization too much credit and the individual too little. Also transformers were themselves a continuation of prior work like multi head attention. And it is possible that transformers were not needed - see this discussion from the other day: https://news.ycombinator.com/item?id=41732853
Come on... that's so unfair. There is a reason such individuals chose to work at Google and not Apple or Amazon for example and were able to "individually" come up with such work without being pestered by their management to do other stuff.