Comment by trollbridge
7 days ago
Didn't work for me in Unsloth, but it will probably be fixed in a day or two when the next batch of updates comes out.
7 days ago
Didn't work for me in Unsloth, but it will probably be fixed in a day or two when the next batch of updates comes out.
Have Prism-ML upstreamed their forked code?
Yeah it's a llama.cpp fork and it's linked everywhere on their repo
Of course — I compiled it and ran it yesterday. Not aware if they have a PR in place with the main project, though as I recall I ran the last Bonsai model without needing it so I guess there might be plans.