← Back to context

Comment by Dylan16807

6 months ago

If your goal is "a TPU" then you buy a mac or anything labeled Copilot+. You'll need about $600. RAM is likely to be your main limit.

(A mid to high end GPU can get similar or better performance but it's a lot harder to get more RAM.)

6 comments

Dylan16807

Reply
oblio  6 months ago

I want something I can put in my own PC. GPUs are utterly insane in pricing, since for the good stuff you need at least 16GB but probably a lot more.

  • Dylan16807  6 months ago

    9060 XT 16GB, $360

    5060 Ti 16GB, $450

    If you want more than 16GB, that's when it gets bad.

    And you should be able to get two and load half your model into each. It should be about the same speed as if a single card had 32GB.

    • oblio  6 months ago

      > And you should be able to get two and load half your model into each. It should be about the same speed as if a single card had 32GB.

      This seems super duper expensive and not really supported by the more reasonably priced Nvidia cards, though. SLI is deprecated, NVLink isn't available everywhere, etc.

      2 replies →