Comment by namaria

Bingo. LLMs are consuming data. They cannot generate new information, they can only give back what already exists or mangle it.

It is inevitable that they will degrade the total sum of information.