Comment by telotortium
10 months ago
Entirely due to the unified RAM between CPU and GPU in Apple Silicon. Laptops otherwise almost never have a GPU with sufficient RAM for LLMs.
10 months ago
Entirely due to the unified RAM between CPU and GPU in Apple Silicon. Laptops otherwise almost never have a GPU with sufficient RAM for LLMs.
Should have been clearer. I was thinking of a dedicated in-house LLM server I could use from different laptops.