Comment by jawns
14 hours ago
I could see this being fantastic for classification tasks. Last year I shifted from using LLMs for bulk data classification tasks (1M transcripts) to generating embeddings and categorizing based on cosine similarity. It saved a ton of costs and time, but wasn't as accurate as LLMs. This seems like it can give me Terra-level classification ability with the cost/speed I need.
This ought to work better than SpamAssassin, I'm sure
yup just joined the waiting list with a very similar use case in mind