← Back to context

Comment by papichulo2023

4 days ago

What does "Built for rack-scale agentic efficiency" even means?

If you read past the marketing talk, this is basically a massively multicore system (136) with significantly reduced power usage (300W).

Where does Agentic come into this? ARMs explanation is that future Agentic workloads will be both CPU and GPU bound thus the need for significant CPU efficiency.

We just say words now that sound good for marketing but have no real meaning.

  • > now

    I’d argue we have always done that, and in fact it’s basically the definition of marketing!

It's volume of tokens consumed x number of agents x rack space. Basically agentic computation density.

I was gonna say just big DCs in marketing yap but really wtf does that mean?