Comment by vsgherzi
4 days ago
is this a cpu that's meant for AI training or is it more for serving inference? I don't quite get why I would want to buy an arm CPU over a nvidia GPU for ai applications.
4 days ago
is this a cpu that's meant for AI training or is it more for serving inference? I don't quite get why I would want to buy an arm CPU over a nvidia GPU for ai applications.
It is for orchastrating inference/creating firecracker instances for agents etc. It does'nt have anything to do with actual AI usage.
Interesting thanks