Comment by utopiah
9 hours ago
why not just as you suggested i.e. https://qwen.readthedocs.io/en/latest/run_locally/llama.cpp.... then get the result either via a UI or wget/curl it back?
9 hours ago
why not just as you suggested i.e. https://qwen.readthedocs.io/en/latest/run_locally/llama.cpp.... then get the result either via a UI or wget/curl it back?
I am not sure that llama.cpp also supports image generation models.
it's multimodal, see https://github.com/ggml-org/llama.cpp/blob/master/docs/multi...
Multimodal doesn't guarantee input and output.
> Currently, we support image, audio and video input.
8 replies →