Comment by tzs

Could a company wanting to offer AI to customers in country X where the grid may limit their ability to build the largest data centers there build their large training data centers in some country with a better grid, and just build smaller data centers in X to run the models?

My understanding is the running requires significantly less compute and storage than training, and that training doesn't need low latency so doesn't have to be near the customers.