Comment by throwdbaaway
17 hours ago
Hold on.. the routed experts are in FP8 now? Previously they were in BF16. Nice, this shall cut my download time by half!
17 hours ago
Hold on.. the routed experts are in FP8 now? Previously they were in BF16. Nice, this shall cut my download time by half!
This time they just made FP8 "default", accompanied by "-BF16" model/page (previously "-FP8" was released alongside).