← Back to context

Comment by dron57

6 days ago

Nor do they have to. Inference from different users is batched together.

1 comment

dron57

Reply

catmanjan 6 days ago

Ok? Even if they're batched? Grid energy is batched too