Comment by mythz

Working on a self-hosted OSS AI Server with support for LLM APIs (OpenRouter/OpenAi/Anthropic/Google/etc), Ollama endpoints, ComfyUI and FFmpeg agents. It supports Synchronous, Queued and Reply to Web Callback APIs for each API Feature with typed APIs integrations for C#,TypeScript,JS,Python,Dart,PHP,Java,Kotlin,Swift,F# and VB.NET clients.

https://github.com/ServiceStack/ai-server