Comment by AlienRobot

1 month ago

The value of LLM's come from replacing what generated its training data.

If the distilled model is cheaper, then it's just LLM's getting LLM'ed.