← Back to context

Comment by DreamGen

2 years ago

I am building https://dreamgen.com : platform for story-writing and role-play based on my own open-weight models [1][2]. Sort of alternative to NovelAI and CharacterAI. Launched November last year.

Why? I think building on top of (and using products built on top of) closed models in this space is not sustainable.

Currently the largest limiting factor, and why I am not spending on marketing just yet, is the model quality at longer contexts. This is my main focus right now, and I am in the middle of data collection for opus-v1 (which will also be released in various sizes). I also hope GPU prices will go down soon :D

It's a lot of fun, being able to work on data, models, backend and frontend all within the scope of 1 project.

[1] https://huggingface.co/dreamgen/opus-v0-7b

[2] https://huggingface.co/dreamgen/opus-v0-70b