Comment by qlte

21 hours ago

Or incentivize using the minimum viable model for the job instead of throwing multi trillion parameter Fable sized models at summarizing documents or classification tasks.

I now do like 90% of my routine software dev/sysadmin stuff with Luna on Medium by default, some proportion of which could itself be offloaded to a small Qwen model.