Comment by 7thpower
6 months ago
This is a basic question but maybe you can help: what is a good resource to use to understand how to take advantage of logits?
6 months ago
This is a basic question but maybe you can help: what is a good resource to use to understand how to take advantage of logits?
https://dottxt-ai.github.io/outlines/latest/
For OpenAI, you can just pass in the json_schema to activate it, no library needed. For direct LLM interfacing you will need to host your own LLM or use a cloud provider that allows you too hook in, but someone else may need to correct me on this.
If anyone is using anything other than Outlines, please let us know.
Thank you!