Comment by mentalgear
3 hours ago
Overall this seems like a classifier that gives weighted scores per custom labels. It's certainly useful, but whether it brings higher quality than an LLM in structured output mode has to be seen in objective benchmarks.
Zero shot classifier indeed. Reminiscent of asking an llm a yes/no question, constraining the output to either yes or no, and looking at the logits directly
And each question is a separate single token model completion done in parallel