Comment by gitpusher42 8 hours ago Thank you! Under good conditions it achieves approx a 67% cache hit rate with 16 expert slots 1 comment gitpusher42 Reply WithinReason 6 hours ago That's great, now I wonder how cache hit rate scales for larger models. Do you have any plans trying Qwen 3.6 or larger?
WithinReason 6 hours ago That's great, now I wonder how cache hit rate scales for larger models. Do you have any plans trying Qwen 3.6 or larger?
That's great, now I wonder how cache hit rate scales for larger models. Do you have any plans trying Qwen 3.6 or larger?