Comment by ants_everywhere

They have definitely open sourced the inference code. I haven't any training code. I don't think HAI-LLM is open source.

But certainly you can take the architecture from the paper and train a similar model. Or you can try to remove the alignment and produce and uncensored version then realign it.

But at least part of the advantage they have is training on Chinese internet data from inside the great firewall that (AFAIK) US companies don't have access to for any price.