Comment by lta

6 days ago

Yeah it's a llama.cpp fork and it's linked everywhere on their repo

Of course — I compiled it and ran it yesterday. Not aware if they have a PR in place with the main project, though as I recall I ran the last Bonsai model without needing it so I guess there might be plans.