← Back to context Comment by cassianoleal 8 hours ago > when unsloth has quants availablehttps://huggingface.co/unsloth/Qwen3.6-27B-GGUF 3 comments cassianoleal Reply verdverm 8 hours ago That was quick (compared to the 1T Kimi-2.6, not surprising) danielhanchen 8 hours ago Haha :) We had some issues with Kimi-2.6 since it was int4 and we were investigating how to handle it :) verdverm 5 hours ago Appreciate what y'all do! We were slacking about how many HGX-B300 it would take to run Kimi and it looks like we could actually fit 2-3 Kimis on a single HGX.
verdverm 8 hours ago That was quick (compared to the 1T Kimi-2.6, not surprising) danielhanchen 8 hours ago Haha :) We had some issues with Kimi-2.6 since it was int4 and we were investigating how to handle it :) verdverm 5 hours ago Appreciate what y'all do! We were slacking about how many HGX-B300 it would take to run Kimi and it looks like we could actually fit 2-3 Kimis on a single HGX.
danielhanchen 8 hours ago Haha :) We had some issues with Kimi-2.6 since it was int4 and we were investigating how to handle it :) verdverm 5 hours ago Appreciate what y'all do! We were slacking about how many HGX-B300 it would take to run Kimi and it looks like we could actually fit 2-3 Kimis on a single HGX.
verdverm 5 hours ago Appreciate what y'all do! We were slacking about how many HGX-B300 it would take to run Kimi and it looks like we could actually fit 2-3 Kimis on a single HGX.
That was quick (compared to the 1T Kimi-2.6, not surprising)
Haha :) We had some issues with Kimi-2.6 since it was int4 and we were investigating how to handle it :)
Appreciate what y'all do! We were slacking about how many HGX-B300 it would take to run Kimi and it looks like we could actually fit 2-3 Kimis on a single HGX.