Comment by ggambetta
1 day ago
> And the public funded the research that made it possible. The transformer architecture,
Errr pretty sure that was Google?
1 day ago
> And the public funded the research that made it possible. The transformer architecture,
Errr pretty sure that was Google?
The engineers at google did not sit in a blank room and come up with these ideas out of nowhere. They read the literature to figure out what the hell to do. If you look at the Attention is All You Need whitepaper, you will find there are 32 references, like most ~10 page manuscripts.
The author never claims otherwise?
Did the public fund googles research?
The public of the US, China, Japan, the UK, and Canada at the very least contributed to every precursor to transformers in the history of AI. Public and private universities, government grants to them, government projects, prizes to government contests, direct government investment into and subsidies for companies doing commercial research, tax breaks to operators designed to encourage the growth of the field, and large government contracts to use things the government might not even have good uses for yet all add up to government assisted funding.
https://en.wikipedia.org/wiki/History_of_artificial_intellig...
The public “funded” these models in the sense of contributing to their training data.
The foundations of it, yes: "all of these were publicly or quasi-publicly funded"
8 replies →
[dead]