Comment by wernam
20 hours ago
AMD Ryzen AI/Strix Halo is for running locally on your hardware. Openrouter is for evaluating the models you'll be running locally, before buying the hardware.
In any case, 128-256GB unified memory systems running MOE models is the "cheap" option, RTX6000 is the step above it.
> 128-256GB unified memory systems running MOE models is the "cheap"
I'm not familiar with these. How much does one cost, and from what store / what product name?