Comment by simonw

You can run a model locally on much less expensive hardware. It's training that requires the really big GPUs.