Comment by fcanesin

9 hours ago

Yes, DFlash is currently a SOTA speculative decoding method that Xiaomi just used in their MiMo model for >1000tkps

0 comments