Comment by nialv7
5 months ago
> Didn't expect to go back to macOS but their basically the only feasible consumer option for running large models locally.
Framework Desktop! Half the memory bandwidth of M4 Max, but much cheaper.
5 months ago
> Didn't expect to go back to macOS but their basically the only feasible consumer option for running large models locally.
Framework Desktop! Half the memory bandwidth of M4 Max, but much cheaper.
Does that equate to half the speed in terms of output? Any recommended benchmarks to look at?
https://kyuz0.github.io/amd-strix-halo-toolboxes/