Comment by brainless
13 hours ago
Lovely to see the push for tiny models.
I have been building for small (20B or less) models for quite a while. Highly focused/constrained agents, many of them running together in some kind of task orchestration mode to achieve what feels like one "agent".
I build (privacy first) desktop apps this way and I want to get into mobile apps with similar ideas but tiny models.
Commercial or FOSS? I've been researching the mobile side and it's very exciting!
Most of my own products are GPLv3 licensed. There are a few with MIT but I may switch to GPLv3. I want to make money with hosting though.
Desktop apps are with Tauri, so they are also web apps if/when I sell hosting.
Give it a go and let us know!