Comment by computerex

5 days ago

Shameless plug to my own inference engine: https://github.com/computerex/dlgo

- Inference for a bunch of open weights architectures

- Diffusion image generation fir Z ai turbo

- Vision input into LLM for inference

- Vulkan/fast CPU, optimized kernels

- Playground for testing

- Last but not least, system one fast inference mode with same API semantics as Jev

Decision models work by using a backbone model like qwen 3.5 9b, along with a special linear head that provides the readout for the forward pass.

2 comments

computerex

Reply
skissane  5 days ago

Suggestions:

- add to your README links to download the relevant .gguf files – I assume from HuggingFace?

- or even implement your own equivalent of `ollama pull`/`list`/`rm`/etc

- add some CI using Github Actions (or an alternative if you prefer)

- as well as `go install github.com/computerex/dlgo/cmd/dlgo@latest`, also document `go install github.com/computerex/dlgo/cmd/dlgo-vision@latest`, `go install github.com/computerex/dlgo/cmd/dlgo-image@latest`, etc (obvious to anyone experienced with Go, not to many inexperienced with it)

actually, I try running `go install github.com/computerex/dlgo/cmd/...@latest` on my Mac and I get a lot of errors; some of them are because `cmd/gpu-watchdog` is trying to use Windows-specific APIs (e.g. `syscall.NewLazyDLL`) even on macOS