Comment by algo_trader

Are all these "post/mid-training tweaks" important if you have a specific domain with abundant/verified/synthesis data and labels?

Can a small team working on ASI/domain-specific stick to scaling 2024-era best practices training stack? Or will they miss massive improvements?