Comment by whstl

I have a couple small apps that have a (non-LLM) model, and originally the models and code were in PyTorch, built by Python devs.

The original plan was to ship Python. However I found out I can migrate them to CoreML, and now it's a model file + Swift code. I got some massive performance improvements as well.

Of course, this doesn't work at all for non-Mac environments, but it was nice to be able to do it. (Also doesn't solve the duplicate large models problem)