Comment by rustyhancock
2 days ago
It's 2.5kW so it likely won't sit in your computer (quite beyond what a desktop could provide in power alone to a single card, let alone cool). It's 8.5cm^2 which is a beast of a single die.
Basically logistically it's going to need to be in a data centre.
It's ideal for small context high throughput. Perhaps parsing huge text piles like if you had the entire Epstein files as text.
I think Claude code benefits from larger context to keep your entire project in view and deep reasoning.
What this would certainly replace is when Claude dispatched to Haiku for manual NLP tasks.
> It's 2.5kW so it likely won't sit in your computer (quite beyond what a desktop could provide in power alone to a single card, let alone cool). It's 8.5cm^2 which is a beast of a single die.
I wonder how you cool a 3x3cm die that outputs 2.5 kW of heat. In the article they mention that the traditional setup requires water cooling, but surely this does as well, right?
Can't imagine what else could manage that nearly 2.8W/mm2.
It does make you wonder if they copy is misleading about something so simple how much else could be puffery?
Maybe they mean that a standard liquid cooling system will work?