Comment by _joel

You can self host OpenAPI compatible models with lmstudio and the like. I've used it with https://anythingllm.com/