Comment by root_axis
19 hours ago
It's really not. The hardware to support anything even remotely practical starts in the tens of thousands of dollars. Quantized 40b param models are impressive, but are basically toys.
19 hours ago
It's really not. The hardware to support anything even remotely practical starts in the tens of thousands of dollars. Quantized 40b param models are impressive, but are basically toys.
there are plenty of providers of open source models at lower prices than the frontier companies. you're just not well informed.