Comment by cgearhart
1 day ago
I mean, they’ve released a framework to access the on device model https://developer.apple.com/documentation/FoundationModels
1 day ago
I mean, they’ve released a framework to access the on device model https://developer.apple.com/documentation/FoundationModels
They're just too small though, maybe in the future you will be able to run a larger model on device or smaller models will become more finetuneable to be actually useful, but the current slate are pointless.