← Back to context Comment by AureliusMA 3 hours ago How large would a 1 billion token kv even be ?! 1 comment AureliusMA Reply AntiUSAbah 2 hours ago 30TB for 4 bit, 60tb for 8bit res
30TB for 4 bit, 60tb for 8bit res