← Back to context

Comment by ig0r0

12 hours ago

yes, with qwen3.8-27b-4bit run via rapid-mlx i can get to about 200k

2 comments

ig0r0

Reply

metadat 11 hours ago

Nice.. and how many toks/sec?

ig0r0 2 hours ago

Around 20