Comment by Tenoke

The thousands of tasks are inference but I also use ray to train/update a double digit models simultaneously (~1 per user).