Comment by manmal

14 days ago

Won’t prompt processing need the full model though, and be quite slow on a Mac?

Yes, that's what I tried to express. Large prompts will probably be slow. I tried a 120k prompt once and it took 10min to process. But you still get a ton of world knowledge and fast response times, and smaller prompts will process fast.