← Back to context Comment by 3abiton 10 months ago So more 'mature' models might arise in the near future with less params and better benchmarks? 6 comments 3abiton Reply coder543 10 months ago That's been happening consistently for over a year now. Small models today are better than big models from a year or two ago. raducu 10 months ago "Better", but not better than the model they were distilled from, at least that's how I understand it. salemba 10 months ago I think this is how the "child brain" works too. The better the parents and the environement are, the better the child evolution is :) cristiancavalli 10 months ago Not at all — how many people were geniuses and their parents not? I can name several and I’m sure with a quick search you can too. 1 reply → andreasmetsala 10 months ago They might also be more biased and less able to adapt to new technology. Interesting times.
coder543 10 months ago That's been happening consistently for over a year now. Small models today are better than big models from a year or two ago.
raducu 10 months ago "Better", but not better than the model they were distilled from, at least that's how I understand it. salemba 10 months ago I think this is how the "child brain" works too. The better the parents and the environement are, the better the child evolution is :) cristiancavalli 10 months ago Not at all — how many people were geniuses and their parents not? I can name several and I’m sure with a quick search you can too. 1 reply →
salemba 10 months ago I think this is how the "child brain" works too. The better the parents and the environement are, the better the child evolution is :) cristiancavalli 10 months ago Not at all — how many people were geniuses and their parents not? I can name several and I’m sure with a quick search you can too. 1 reply →
cristiancavalli 10 months ago Not at all — how many people were geniuses and their parents not? I can name several and I’m sure with a quick search you can too. 1 reply →
andreasmetsala 10 months ago They might also be more biased and less able to adapt to new technology. Interesting times.
That's been happening consistently for over a year now. Small models today are better than big models from a year or two ago.
"Better", but not better than the model they were distilled from, at least that's how I understand it.
I think this is how the "child brain" works too. The better the parents and the environement are, the better the child evolution is :)
Not at all — how many people were geniuses and their parents not? I can name several and I’m sure with a quick search you can too.
1 reply →
They might also be more biased and less able to adapt to new technology. Interesting times.