Comment by dmitrygr
12 hours ago
> Purpose-Built for Agentic AI
From the "fridge purpose-built for storing only yellow tomatoes" and "car only built for people whose last name contains the letter W" series.
When can this insanity end? It is a completely normal garden-variety ARM SoC, it'll run Linux, same as every other ARM SoC does. It is as related to "Agentic $whatever" as your toaster is related to it
> It is as related to "Agentic $whatever" as your toaster is related to it
These things have hardware FP8 support, and a 1.8TB/s full mesh interconnect between CPUs and GPUs. We can argue about the "agentic" bit, but those are features that don't really matter for any workload other than AI.
The huge interconnect would also useful be for HPC tasks. The FP8 not so much, HPC still loves FP64.
Would cloud gaming platforms benefit from the interconnect?
Don't think they would. Games aren't nearly as hungry for memory bandwidth as LLMs are. Also, I expect that the VRAM/GPU/CPU balance would be completely out of whack. Something would be twiddling its thumbs waiting for the rest of the hardware.
mem bw between cores matters for .... literally all workloads that are not single-core (read: all). And FP8 matters not at all cause inference on cpu is too slow to be of any use whatsoever in the days of proper accelerators
The power and importance of marketing is deeply underappreciated by us technical types.
And yet more than a little Gavin Belson "Box III" vibes here. Fortunately, no signature edition.
I don’t underappreciate it, but I do despise it.
> It is a completely normal garden-variety ARM SoC
To mis-quote the politician quip:
How can you tell a marketer is lying?
Answer: His/her mouth is moving.