Comment by root_axis
21 hours ago
> The better open models are the less you need frontier models
True in theory, but in practice hardware availability and cost will keep open source impractical for years to come.
21 hours ago
> The better open models are the less you need frontier models
True in theory, but in practice hardware availability and cost will keep open source impractical for years to come.
It will be impractical to self host, but not to get one that's served from other providers (which won't have to recuperate loses from training).
If your moat is "Our vendors aren't expanding fast enough to supply our competitors!", you don't have a moat.
It's already very practical lmao
It's really not. The hardware to support anything even remotely practical starts in the tens of thousands of dollars. Quantized 40b param models are impressive, but are basically toys.
there are plenty of providers of open source models at lower prices than the frontier companies. you're just not well informed.