Comment by ydu1a2fovb

13 days ago

Can you suggest any good llms for cpu?

I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models as they are more efficient to run.

Following.

  • I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models as they are more efficient to run.

  • Hey Olivaw, saw a comment of yours asking about planners. Wanted to reply but it’s expired. Check out bullet journalling.

    • Thanks for the reply!

      Bullet journaling is neat, but I'm far too whacky with my notes to stick to that kind of structure.

      I have various other structures I implement, but they're just hodge podges of things.