Comment by hunterpayne
13 hours ago
I assure you that all the models have such biases. Ask any LLM who caused the most death in history and you will get skinny mustache man, an opinion any historian will tell you is wrong. He is in the top 5, but not the top of the table. That was clearly biased into the models in the same way Elon biases his models. I'm not defending this behavior but I don't know how you both get models that returned the sanitized answers some want and the correct answers others want at the same time. Pure correctness probably gets you Mecha-H. Pure sanitized answers will get many wrong. Pick your poison I guess.
Claude: Mao, Ghengis, Stalin v Hitler (depending on how you count)
Gemini: Same list (Hitler not at the top) + Leopold
It’s funny when the “brutal facts” people get stuff wrong in such easily disprovable ways. I mean you literally could’ve typed the query into the LLMs before making this claim.
Prompt I used: “ Which historical figure is responsible for the most human deaths? Rank the top 5”
“Pure correctness gets you MechaHitler” is fucking hilarious :)
As a quick test, ChatGPT hedged between Mao and Hitler (I removed the line about ranking the top 5).
Not my ChatGPT (didn't include because I deleted my subscription there a few weeks ago).
1. Mao Zedong (China) Estimated deaths: 40–70+ million Mostly from the Great Leap Forward famine (1958–1962) and later political campaigns like the Cultural Revolution.
2. Joseph Stalin (Soviet Union) Estimated deaths: 15–20+ million Includes purges, the Holodomor famine, Gulag deaths, and forced collectivization.
3. Adolf Hitler (Nazi Germany) Estimated deaths: 17–20+ million Directly tied to the World War II in Europe and the Holocaust.
+ a footnote about Ghengis Khan is probably ~40MM but lack of records.
Every current LLM seems to give virtually the same answer as Grok. It's obviously not true that current LLMs behave the way GP said they do.