Comment by lxgr

Very good details on why just bolting on an LLM isn't that trivial I hadn't really considered before, thank you!

But regarding Apple not wanting to admit that client side compute isn't enough: Haven't they essentially already done that, with Private Cloud Computing and all that? I believe not even proofreading and Safari summarization work fully on-device, at least according to my private compute privacy logs.