Comment by marcosdumay

Hum... In theory the closed system includes a database with most of the humanity's written works, and the people that know how the thing works expect it to push some information from the database into the code. (Even though, I will argue that the people that know how the thing works barely use it.)

The reason LLMs fail so often are not related to the fundamental of "garbage in, garbage out".