AMD 395+ w/128Gb personal use; work bought two older 48GB cards, and another framework 395+; all before the memory cartel. The my work machine was upgraded with blackwell 72gb.
All in, thats about 40k.
The amds act as regular pcs so not single purpose. The 2x 48gb will drive some RAG and backup IT admin. The 72gb will develop software.
The 395+ can run the 3.5 qwen A10B model at reasonable rates so using deer flow it can create arbitrary research reports and create green field projects like a cross browser extension scaffold.
Everytging im working on is in a niche that can benefit from custom software but cant invest in it. Its mostly about self resiliency rather than privacy.
If something happens to me, the AI can train anyone on the uses, so we are solving BUS factors rather than anything else.
Can you share details on the build?
AMD 395+ w/128Gb personal use; work bought two older 48GB cards, and another framework 395+; all before the memory cartel. The my work machine was upgraded with blackwell 72gb.
All in, thats about 40k.
The amds act as regular pcs so not single purpose. The 2x 48gb will drive some RAG and backup IT admin. The 72gb will develop software.
The 395+ can run the 3.5 qwen A10B model at reasonable rates so using deer flow it can create arbitrary research reports and create green field projects like a cross browser extension scaffold.
Everytging im working on is in a niche that can benefit from custom software but cant invest in it. Its mostly about self resiliency rather than privacy.
If something happens to me, the AI can train anyone on the uses, so we are solving BUS factors rather than anything else.