Comment by HarHarVeryFunny

It seems that anyway most of the value is in the speed and cost.

If it really matters to you whether whether some business-specific classification confidence is above/below some specific threshold (vs just relative order), then you'd be better off training or fine tuning a custom model for that. Maybe that is something that TypeSafe are planning to also provide?