Comment by sammyyyyyyy
1 day ago
This is my side “hobby”. And compute is quite expensive. But if the community’s responsive is good, I will definitely think about it! Btw, chatterbox is a great model and inspiration
1 day ago
This is my side “hobby”. And compute is quite expensive. But if the community’s responsive is good, I will definitely think about it! Btw, chatterbox is a great model and inspiration
Thanks can you share details about compute economics you dealt with ?
Yeah sure. The training was about ~250 dollars, which is quite low by today’s standards. And I spent a bit more on ablations and research
Very cool work, especially for a hobby project.
Do you have any plans to publish a blog post on how you did that? ?What training data and how much? Your training and ablations methodology, etc.