Comment by Neywiny

1 day ago

So there's a path to 4 in order to run trillion parameter models? But you can't buy them or fit them in the case? Maybe in the Halo 2...

That all said, running frontier models locally offline would be very nice

4 comments

Neywiny

Reply
ilaksh  1 day ago

It's over $100k.

  • Neywiny  1 day ago

    Cheaper than an entry level human. But I've never used a model that size for development so idk if they could replace it. The work I do with even nemotron 550b, it's so dumb it's infuriating. Same with the free Google one (for anything sanitized/generic)