← Back to context

Comment by cactusplant7374

11 hours ago

What is the TPS of DeepSeek? All of the LLMs I have tried are slow as molasses. \

2 comments

cactusplant7374

Reply

micw 11 hours ago

I use TensorX (EU hosted) and get 330TPS

selectodude 9 hours ago

I pretty reliably get 200 tokens per second on deep infra.