← Back to context Comment by nshotton 3 hours ago sweet, is there any plans to implement VLLM in the future? 1 comment nshotton Reply segmenta 2 hours ago vLLM works today - it exposes an OpenAI-compatible endpoint, and you can point Rowboat at a custom base URL in model settings.
segmenta 2 hours ago vLLM works today - it exposes an OpenAI-compatible endpoint, and you can point Rowboat at a custom base URL in model settings.
vLLM works today - it exposes an OpenAI-compatible endpoint, and you can point Rowboat at a custom base URL in model settings.