Comment by jstummbillig

How about if we get away from written text as the input, to something more fundamental, that then also is able to produce text (among other things)?

Given that humans learn to talk while having encountered a measly number of word instances, and, given enough time, we should always be able to improve on the lottery that is biology, it does seems fairly likely.