Comment by bit1993
3 days ago
> I think the cutoff date is closing in on our current now. If models cannot easily become bigger, they will likely advertise using "up-to-date-ness". Maybe they will be merely a few days behind. Or bigger models will make use of smaller but more up-to-date models
But they will still rely on assembly, C, Rust, Linux, HTML, TCP/IP... Doesn't matter how up to date they are, they rely on existing code they have been trained on, they can't just create new languages without the training data.
Except they already have invented new languages.
https://medium.com/@trezzescience/the-ai-that-invented-its-o...
That's not what I mean, even I can invent my own language that only I use, but if that language is not widely deployed and used by other people or LLM models, it's just a toy language.