Sort of a hardware advancement. I'd say it's more of a sidegrade between different types of well-established processor. Take out a couple cores, put in some extra wide matrix units with accumulators, watch the neural nets fly.
But I want to point out that going from CPU to TPU is basically the opposite of a Moore's law improvement.
Sort of a hardware advancement. I'd say it's more of a sidegrade between different types of well-established processor. Take out a couple cores, put in some extra wide matrix units with accumulators, watch the neural nets fly.
But I want to point out that going from CPU to TPU is basically the opposite of a Moore's law improvement.
Yeah, I'm a regular Joe. How do I get one and how much does it cost?
If your goal is "a TPU" then you buy a mac or anything labeled Copilot+. You'll need about $600. RAM is likely to be your main limit.
(A mid to high end GPU can get similar or better performance but it's a lot harder to get more RAM.)
I want something I can put in my own PC. GPUs are utterly insane in pricing, since for the good stuff you need at least 16GB but probably a lot more.
4 replies →
$500 if you catch a sale at Costco or Best Buy!