Comment by llm_nerd
12 hours ago
> If Jev is fundamentally trained using RLCD
Big if. More likely, it seems, is they started with an open LLM model and fine-tuned and repurposed it via their "RLCD" process.
12 hours ago
> If Jev is fundamentally trained using RLCD
Big if. More likely, it seems, is they started with an open LLM model and fine-tuned and repurposed it via their "RLCD" process.
The FAQ on the Jet announcement (https://typesafe.ai/blog/introducing-system-one-models-and-j...) claims it was trained with their own data:
Where Does Our Training Data Come From?
TypeSafe is primarily a data research lab, which is how the biggest results in AI get made. We make all the data ourselves. We wouldn’t train on your data even if you asked us to (no offense). We do some pretty sophisticated stuff, but if you want to find out more, we’d have to hire you.
> We make all the data ourselves.
I mean, this claim is simply preposterous, and is discountable as ridiculous nonsense on its face.
Really? I read it as saying they use 100% synthetic data, which is made in house. Why is that preposterous?
2 replies →