Comment by fooker

There's no program you run to 'make the thing'.

It's mostly ad hoc scripts and some pretty horrible hacks being run by a hundred engineers trying to improve a thousand different things at once with a hundred thousand GPUs.

I'm sure once we understand the tech better, the training process will look like running a program.