Comment by causal

Not to mention the "distilled" models almost certainly have other training inputs as well, again watering down the meaning of the word.

And if just partial output is all that it takes to declare a model distilled, then every model trained on Internet content since 2023 is now technically a "distilled" ChatGPT and Claude model.