← Back to context Comment by Zee2 5 days ago > a ∼3B-parameter on-device model 2 comments Zee2 Reply ThomasBb 5 days ago There are even already some local AFM to Open AI API bridge project on GitHub - that lets you point basically any Open AI compatible client at the local models. Super nice for basic summarisation and completions. JKCalhoun 5 days ago I was worried "device" was a Mac mini, not an iPhone. (I already have been running models on my MacBook Pro.)
ThomasBb 5 days ago There are even already some local AFM to Open AI API bridge project on GitHub - that lets you point basically any Open AI compatible client at the local models. Super nice for basic summarisation and completions.
JKCalhoun 5 days ago I was worried "device" was a Mac mini, not an iPhone. (I already have been running models on my MacBook Pro.)
There are even already some local AFM to Open AI API bridge project on GitHub - that lets you point basically any Open AI compatible client at the local models. Super nice for basic summarisation and completions.
I was worried "device" was a Mac mini, not an iPhone. (I already have been running models on my MacBook Pro.)