Comment by danielhanchen

Unsure but yes most likely they use YaRN, and maybe trained a bit more on long context maybe (or not)