Comment by pgkr
1 year ago
We're working on a follow-up post focused on our analysis of the open-source open-weight 671B model. What we're seeing is that questions related to the Chinese government produce an empty chain-of-thought followed by pro-Chinese-government talking points.
It is too late, I got mixed signals.
This is going to be very hard to trust anything about it anymore, unless running the 671B locally an my own systems.
We ran the 671B locally and found a ton of bias. See part 2 of our analysis here: https://news.ycombinator.com/item?id=42918935
Happy to send you the dataset if you'd like! Please reach out to our email linked in the post.