Comment by mdp2021
7 hours ago
> It costs something like $300,000 for the hardware to run a model of that size
You did not compute that as the cost for a speculative card from Taalas, right?
7 hours ago
> It costs something like $300,000 for the hardware to run a model of that size
You did not compute that as the cost for a speculative card from Taalas, right?
It's the cost of the current nvidia hardware used to run these models. Of course all bets are off if you are accounting for some future chip that doesn't exist yet which could cost less.