Comment by metalliqaz
21 hours ago
I just "invested heavily" (relatively modest, but heavy for me) in a PC for local inference. The RAM was painful. Anyway, for my focused programming tasks the 30B models are plenty good enough.
21 hours ago
I just "invested heavily" (relatively modest, but heavy for me) in a PC for local inference. The RAM was painful. Anyway, for my focused programming tasks the 30B models are plenty good enough.
I am extremely fortunate having bought 64GB of CL30 DDR5 Ram for ~200 USD just 4 months ago!
My computer is now worth more than when I bought it