Comment by SiempreViernes
2 days ago
Is it? I'd expect most of the training set to be synthetic data extrapolated from a small set of human authored texts.
2 days ago
Is it? I'd expect most of the training set to be synthetic data extrapolated from a small set of human authored texts.
Most of the training set is half of the Internet. LLMs are pre-trained on general set of human biases and patterns of thinking.