Comment by madduci

2 hours ago

Are you using the right configuration for your own CPU?

On a Laptop with 32 GB RAM and Iris Xe integrated graphic card, I get between 11-18 Tokens/Second with Qwen 3.8 27B and llama.cpp with sysl Intel optimisations. Same results with the vulkan back end, although sometimes it ends in weird segmentation faults due to the memory consumption.