Comment by danielmarkbruce
2 days ago
Yes, it was. Nobody says a system or product works a certain way and means the system while it's half built. "Bridges drop cars in the water!". Right.
You aren't in this field. You are clearly wrong and just can't handle it.
> Nobody says a system or product works a certain way and means the system while it's half built. "Bridges drop cars in the water!". Right.
To understand how an engine works, it's important to understand what a piston does as part of the engine.
You are conflating "half built" with "a piece of a system".
The model weights change as the model goes through the training process. They aren't stored after pre-training is done and other weights are put somewhere else. It's more like pottery - the thing changes. It's not correct to say something is soft and malleable because it once was.
> The model weights change as the model goes through the training process.
Yes. They do. You are absolutely right about that.
But the model architecture doesn't change as a result of the training process. A piston doesn't suddenly turn into a digital watch as a result of tuning an engine. Similarly, the transformer part of a GPT model doesn't suddenly turn into something else as a result of optimizing a loss function.
---
i've got other stuff to do, so i'm stopping here.
11 replies →
You're using the fact the both parts of training affect the same weights to support your argument that they're making the system do something fundamentally different after RL?
1 reply →