Comment by dalemhurley
5 days ago
Hard disagree. This is the first step not the last and proves to other countries that this can be done.
5 days ago
Hard disagree. This is the first step not the last and proves to other countries that this can be done.
This model is going to start miles behind the frontier and the gap will only grow.
Why would the gap grow? There is no more training data to acquire, frontier model are training on the entire internet. Everything from now on is just fine-tuning.
Orders of magnitude less compute for pre- and post-training than the the frontier labs.
Your statement assumes training data is the only thing that matters for the big players, while not considering it limiting for the small Norwegian model. That’s a fallacy.
1 reply →