Comment by DennisP

6 months ago

AI generates useful stuff, but unless it took a lot of complicated prompting, it's still true that you could "just ask the question yourself."

This will change as contexts get longer and people start feeding large stacks of books and papers into their prompts.

> you could "just ask the question yourself."

Just like googling, AIing is a skill. You have to know how to evaluate and judge AI responses. Even how to ask the right questions.

Especially asking the right questions is harder than people realize. You see this difference in human managers where some are able to get good results and others aren’t, even when given the same underlying team.

No, new more-capable and/or efficient models have been forged using bulk outputs of other models as training data.

These inproved models do some valuable things better & cheaper than the models, or ensembles of models, that generated their training data. So you could not "just ask" the upstream models. The benefits emerge from further bulk training on well-selected synthetic data from the upstream models.

Yes, it's counterintuitive! That's why it's worth paying attention to, & describing accurately, rather than remaining stuck repeating obsolete folk misunderstandings.

  • That's a process that's internal to companies doing training. It has nothing to do with publishing outputs on the internet.