← Back to context

Comment by dron57

10 days ago

Nor do they have to. Inference from different users is batched together.

1 comment

dron57

Reply

catmanjan 9 days ago

Ok? Even if they're batched? Grid energy is batched too