Comment by skerit
13 hours ago
I didn't know Oxen.ai. I took a look at your docs on how to fine-tune LLMs:
> Oxen.ai supports datasets in a variety of file formats. The only requirement is that you have a column where each row is a list of messages. Each message is an dictionary with a role and content key. The role can be “system”, “user”, or “assistant”. The content is the message content.
Oh, so you're forced to use the ChatML multi-turn conversation format.
No comments yet
Contribute on Hacker News ↗