Comment by FranciscoCarlos
15 days ago
Yeah, it can be worked around with in-context instructions but they still tend to scope, delegate and architect without awareness of the fact that agents exist and work. It's an actual big deal IMHO, opus 5.5 is the most updated AFAIK.
Nowadays the scraped training data is only one part of the training process. The RL phase of training can instill a knowledge of tactics like sub-agent delegation without documentation about them being present in the training corpus. Context isn't the only way for a model with an early knowledge cutoff to know about it.
Still a crutch around incomplete pre-training data, a ton of useful knowledge wont be properly represented on the weights.