← Back to context Comment by nok22kon 12 hours ago that's incorrect in the presence of batching. it's tough work making it truly deterministic:https://x.com/FireworksAI_HQ/status/2069873437217276015 1 comment nok22kon Reply vidarh 12 hours ago It's not that hard. What is hard is making it truly deterministic and retain high throughput.
vidarh 12 hours ago It's not that hard. What is hard is making it truly deterministic and retain high throughput.
It's not that hard. What is hard is making it truly deterministic and retain high throughput.