Comment by mattnewton
5 years ago
I think "calculators mean students can't do arithmetic anymore" is perhaps an uncharitable take because it ignores that calculators aren't also trying to learn arithmetic from examples of people using them. Eventually grammar correction algorithms will injest text written with them or other grammar correction algorithms as ground truth in their efforts to improve and adapt to new idioms- this may already be the case.
NLP researchers are tearing their hair out about this right now, since people are posting mountains of GPT/etc.-generated text online with no easy way to distinguish whether it's of human or other origin.
Reminds me of a scifi book where the Internet-analogue is so corrupted with junk deliberately injected by filtering services so that they can sell you the filters that it's impossible to use "naked".
I think it's either Neal Stephenson or maybe Stephen Baxter, but I'm not sure which book it was an aside in (it's not Fall, I haven't read that yet, though that appears to have a similar idea).
I guess we're entering a new phase of language evolution, then; whether we want it or not.
Maybe we should create a neural network model that could label arbitrary text as -- nah!
That's a Gan but with more steps right?
Well... you can read it.
I might be wrong, but so far I think it's been pretty easy to tell if text came from a human or a deep-learning system.
Granted, that probably doesn't scale well.
That has been true up until very recently, but lately there has emerged an uncanny valley that has confused the distinction between "underpaid freelance (ESL) writer farm" and "shoddy but roughly convincing neural language model" so that you may be convinced the blogspam you may happen upon across the internet may just as easily be computer-generated as anything else.
2 replies →
Most, not all.
This sounds like a case of "garbage in garbage out". Machine learning needs to account for that regardless.