← Back to context Comment by mmoskal 2 years ago Their tech report says one inference deployment is around 400 GPUs... 1 comment mmoskal Reply fspeech 2 years ago You need that to optimize load balancing. Unfortunately that gain is not available to small or individual deployment.
fspeech 2 years ago You need that to optimize load balancing. Unfortunately that gain is not available to small or individual deployment.
You need that to optimize load balancing. Unfortunately that gain is not available to small or individual deployment.