← Back to context Comment by october8140 1 year ago You can get 1t/s on a raspberry pi.https://youtu.be/o1sN1lB76EA?si=i8ecEBjLdV0zewFQ 2 comments october8140 Reply klohto 1 year ago this has nothing to do with the full 671B and the ollama models are distilled qwen2.5 thomquaid 1 year ago I appreciate both of these comments, thank you both.
klohto 1 year ago this has nothing to do with the full 671B and the ollama models are distilled qwen2.5 thomquaid 1 year ago I appreciate both of these comments, thank you both.
this has nothing to do with the full 671B and the ollama models are distilled qwen2.5
I appreciate both of these comments, thank you both.