Comment by thwayunion

What are some (non-nefarious) applications of generative language models that produce language which isn't constrained by some sort of rationality or directed by some sort of high-level goal?

The point isn't the math. The point is that, in math and similar disciplines, it's harder to get away with producing mostly undirected gibberish that happens to have some imputed meaning. The point is "use language to do something where it's easy to verify correctness and generating infinite amounts of synthetic data is trivial"

If a language model can't even do high school algebra, then I have a lot less confidence that it will ever be useful for customer service applications or any other number of potential applications outside of propaganda, advertising, and spam.