Comment by randbyte
13 hours ago
lol. Have you? What kind of distill you are talking about? It’s only effective in the surface, small scale model or output preference. Not useful for long reasoning chain.
13 hours ago
lol. Have you? What kind of distill you are talking about? It’s only effective in the surface, small scale model or output preference. Not useful for long reasoning chain.
Why lol? Yes. All major labs use SFT... (look at job postings)
> Not useful for long reasoning chain.
I have a feeling you don't actually know anything about ML