Comment by tacoooooooo
10 hours ago
Sounds like its essentially a generalized zero-shot classifier that takes and option set at runtime and works on unstructured inputs.
you pass in your "prompt" and options (described in natural language) that it can respond with, in addition to your input. it gives back that option set with a probability assigned to each one
yes and can do many of those in parallel