← Back to context

Comment by quietraster

6 hours ago

nice setup for this. did any single technique clearly stand out, or did it mostly come down to the base model?

This is answered by the large plot early in TFA. All tests were made using the same model, and adding no special instructions at all provided performance above the average.

The answer is mostly "do nothing, the model will figure it out", with a side of "ask the model to check its work".

This matches my experience, where the job of the engineer is mostly copy pasting requirements, letting the model do the thinking, and then manually testing the results.