The article is about running it on a phone though, and shows an app with their branding running this in text mode on a phone. I'm asking where can I find this app to try what is being demonstrated in this article & video? Appstore only has an image gen app by them and other MLX apps I've tried don't seem to support this model
One of the links on the sidebar goes to "Locally AI" https://apps.apple.com/us/app/locally-ai-by-lm-studio/id6741... it requires an iPhone 17 Pro or Pro Max to run the 27B model though.
I've got both that app and a 17 Pro, but it only lists one of the older Bonsai models not the 27B for me
I only have an iPhone 14 Pro, but under "manage models" it's showing Bonsai 8B and Ternary Bonsai 8B.
2 replies →
It's a LLM model, not a phone app.
Available on HuggingFace: https://huggingface.co/collections/prism-ml/bonsai-27b
Indeed.
The article is about running it on a phone though, and shows an app with their branding running this in text mode on a phone. I'm asking where can I find this app to try what is being demonstrated in this article & video? Appstore only has an image gen app by them and other MLX apps I've tried don't seem to support this model