Comment by pixl97

Again, by our own choices and somewhat hardware limitations.

There is nothing stopping you from adding any kind of sensors you want during a training to an LLM, except money and GPU power at this point.

This seems no different to me at least then someone back in the 80's telling me computers were useless because they were so slow. Hardware only gets faster and more efficient from here.