Comment by mordae

9 hours ago

They have released mixed fp8/fp4 for efficiency. It's still hundreds of gigabytes, though. Give up on local for these.

0 comments