Comment by cedws
19 hours ago
>On April 16, we added a system prompt instruction to reduce verbosity
In practice I understand this would be difficult but I feel like the system prompt should be versioned alongside the model. Changing the system prompt out from underneath users when you've published benchmarks using an older system prompt feels deceptive.
At least tell users when the system prompt has changed.
Its also kinda funny they have to rely on system prompt to control verbosity itself.
It's cheaper than retraining the model.
So? 4.7.1, 4.7.2, etc. makes sense for versioning system prompts.