Comment by metalliqaz
11 days ago
I just "invested heavily" (relatively modest, but heavy for me) in a PC for local inference. The RAM was painful. Anyway, for my focused programming tasks the 30B models are plenty good enough.
11 days ago
I just "invested heavily" (relatively modest, but heavy for me) in a PC for local inference. The RAM was painful. Anyway, for my focused programming tasks the 30B models are plenty good enough.
I am extremely fortunate having bought 64GB of CL30 DDR5 Ram for ~200 USD just 4 months ago!
My computer is now worth more than when I bought it
ugh. $650 for 64GB DDR5-6000, CL36