Comment by fp64
9 hours ago
on the linked GitHub page they list support Diffusers, ComfyUI, vLLM-Omni, SGLang, and LightX2V with links to each
9 hours ago
on the linked GitHub page they list support Diffusers, ComfyUI, vLLM-Omni, SGLang, and LightX2V with links to each
> Diffusers, ComfyUI, vLLM-Omni, SGLang, and LightX2V
I think that's all Python (not a direct executable).
You could just do (see the "Quick Start") four `pip install` and have a dozen lines script to generate the image. But `llama.cpp` and similar do not require e.g. installing Torch (or PyTorch) - you can use `llama.cpp` on a non-specialized machine.
"just"
I don't think I have ever once run "pip install transformers" and had it work without three rounds of fiddling
Or trying to install the whole of CUDA on machines that do not even have a GPU (not Nvidia, not anything past the embedded)...
Yep, that's (also) what I meant ;)
Lean, efficient... Also sensible and trouble-less.
1 reply →