Comment by thewebguyd

Local AI was/is bound to happen, eventually. It'd be smart of Nvidia to get ahead of it.

Non-techy consumers may never do it, but at some point businesses are going to start asking when do they stop paying per token and start running models themselves. Right now the hardware is cost prohibitive, but I doubt that'll always be the case. Eventually the hardware will get cheaper and more available, and Nvidia seems to be betting on that.

They don't care where inference happens, so long as it happens on Nvidia hardware.