Comment by erichocean

Agreed, but how will we find out? Pre-training alone on frontier-class models costs billions of dollars.