Comment by AureliusMA 4 hours ago How large would a 1 billion token kv even be ?! 1 comment AureliusMA Reply AntiUSAbah 4 hours ago 30TB for 4 bit, 60tb for 8bit res
30TB for 4 bit, 60tb for 8bit res