Comment by nacs
7 months ago
The small model/TTF is only 60MB.
The 280GB you saw is the Llama3-70B model which is basically chatgpt level (if not better).
7 months ago
The small model/TTF is only 60MB.
The 280GB you saw is the Llama3-70B model which is basically chatgpt level (if not better).