Comment by jstummbillig

Possibly! It's just hard to reason about from the outside. When does the model benefit from all the ambient knowledge? Idk.

Regardless, it's fairly obvious to me that none of what I do now will require "frontier models" for much longer. Models are getting better more quickly than my problems are getting harder.