Something like this together with MCP can replace APIs for 3rd party integrations.
You just give it instructions to "post a message in slack" and provide it slack MCP tools and it figures out the rest on its own. No need to read up on slack API docs or worry about breaking changes.
I don't think the limit is just on tiny devices. It can also be used in apps on generic computers, because its so small anything can run it reasonably quick.
For example, I am thinking this could be helpful for say if you have a complicated build and test infrastructure, fine tune this model on that infrastructure and then people can say more generic things like build and run this library's test, rather than issuing the exact commands to do that or going to Claude, GHCP, etc
Something like this together with MCP can replace APIs for 3rd party integrations. You just give it instructions to "post a message in slack" and provide it slack MCP tools and it figures out the rest on its own. No need to read up on slack API docs or worry about breaking changes.
Deploying AI on tiny devices like watches, earphones, glasses etc.
Ok, but why? What is the use case?
I don't think the limit is just on tiny devices. It can also be used in apps on generic computers, because its so small anything can run it reasonably quick.
For example, I am thinking this could be helpful for say if you have a complicated build and test infrastructure, fine tune this model on that infrastructure and then people can say more generic things like build and run this library's test, rather than issuing the exact commands to do that or going to Claude, GHCP, etc