Comment by car

I should add that Llama.app and Unsloth Studio provide OpenAI-compatible API endpoints (both use Llama.cpp as their backend).

https://llama.app/docs/api

https://unsloth.ai/docs/new/studio#unsloth-as-an-api-endpoin...