Comment by singularity2001
7 hours ago
Also, why don't they bake in these limitations via reinforcement learning so they can keep the prompt context clear.
7 hours ago
Also, why don't they bake in these limitations via reinforcement learning so they can keep the prompt context clear.
Because it is cheaper to have different behavior for internal use, special (e.g., government) customers, etc. if they are differentiated by things like system prompts and external guardrails than if they are different model versions with their own final training regime, and also its faster and cheaper to respond to problems even with a single public version by updating a system prompt than rertraining.
Presumably because these system prompt “limitations” are not given to government contracts, and training it into the model gets increasingly expensive the more versions you have to maintain.