← Back to context

Comment by testerius

9 hours ago

I use Claude Opus 5.5 and Codex Sol 6.1 in my job and I love it. I wish be able to run local models which have power at least current Opus 5.5 on medium hardware which does not cost millions $. This is my dream, running LLMs and AI agents to just create things for myself. On my really old hardware I can only run simple and small 1.5B model (Qwen2.5-Coder-1.5B) and well... Ihmo it works fine with offloading to GPU and using llama.cpp but it does a lot of mistakes so I deciced to stop using it.

Get a m5 pro mac with 48gb vram and you’re good to go for a few years and that computer can be used for others purpose as well

  • Dog slow, at last for me. I can't crack 30 tokens/s. I'm trying an Intel B70 next.