Comment by hammock

9 hours ago

What does “destroy the system” mean here?

The metaphor doesn't match very well here because stackoverflow is not selling new tape at a premium but giving them for free and reading a stackoverflow answer is harder than asking an LLM.

Could be that AI companies feeding on stackoverflow are selling tape at a premium, and if they tell you it's only supervised learning from a lot of human experts it's going to destroy the nice bubble they have going on around AGI.

Could also be that you have to do the actual theory / practice / correction work for your basal ganglia to "know" about something without thinking about it (i.e. learn), contrary to the novel where the knowledge is directly inserted in your brain. If everyone use AI to skip the "practice" phase lazily then there's no one to make the AI evolve anymore. And the world is not a Go board where the AI can learn against itself indefinitely.

If you have to ask, you aren't ready to know the answer. There are some things you have to figure out on your own. This is one of them.

Use it to train an "AI"? :)

Probably not the OPs intent though. I suspect there are a lot of ways to destroy the system.