Comment by SyzygyRhythm
9 hours ago
As others said, you can run more than one at a time, but even singly, 24 GB can be very useful in a hybrid approach. For instance, I recently had to process hundreds of high-res blueprints. Used Fable for the main orchestration, but all of the OCR and other work I did with a small local model. Didn't waste expensive Fable tokens on simple grunt work.
No comments yet
Contribute on Hacker News ↗