Comment by matteoraso
3 hours ago
>It cant "invent new things". It can only reuse what it already knows about.
This is outdated. With RLVF, LLMs can create their own training data instead of relying on what it's been fed.
3 hours ago
>It cant "invent new things". It can only reuse what it already knows about.
This is outdated. With RLVF, LLMs can create their own training data instead of relying on what it's been fed.
and that training data will not be a "new thing", because AI can't invent new things. Just recycling of what it already "knows".
Yes it is. Do you not know how RLVF works? The AI tries on a task, comes up with a potential solution, and is trained based on whether the solution is valid or not. If proving a previously unproven theorem and then using that information to solve even more theorems doesn't count as creating new information, then literally everything a mathematician does is just recycling what they've been taught.
> and that training data will not be a "new thing", because AI can't invent new things. Just recycling of what it already "knows".
Regardless of the truth of the underlying assertion, this is about as textbook an example of circular logic as it gets. (at least combined with the implicit beginning assertion that "AI can't invent new things.")