← Back to context

Comment by knicholes

6 hours ago

I wonder if Apple has foresight into locally running LLMs becoming sufficiently useful.

It won’t handle serious tasks but I have Gemma 3 installed on my M2 Mac and it is good for most of my needs—-esp data I don’t want a corporation getting its hands on.

  • What kind of tasks are you using it for? I haven't really found any uses for small models.