Thanks, works well but slowly on a Mac Air M3 with 24gb. Will have to try it again after freeing up more ram as it was doing a bit of swapping with Chrome running too.
(later). It did nicely for the default example text but just made weird sounds for a "hello all" prompt. And took longer?!
Thank you for this! My desktop GPU has only 8GB VRAM, but my MacBook has plenty of unified RAM.
Thanks, works well but slowly on a Mac Air M3 with 24gb. Will have to try it again after freeing up more ram as it was doing a bit of swapping with Chrome running too.
(later). It did nicely for the default example text but just made weird sounds for a "hello all" prompt. And took longer?!
Thank you for the contribution! We'll be merging PRs and cleaning code up very soon :)
Can confirm, runs straight forward on 15.4.1@M4, THX.