Comment by seizethecheese

Ok...

So as a black person should I demand that all books written before the civil rights act be destroyed?

The past is messy. But it's the only way to learn anything.

All an LLM does it's take a bunch of existing texts and rebundle them. Like it or not, the existing texts are still there.

I understand an LLM that won't tell me how to do heart surgery. But I can't fear one that might be less enlightened on race issues. So many questions to ask! Hell, it's like talking to older person in real life.

I don't expect a typical 90 year old to be the most progressive person, but they're still worth listening too.

Of course, I have to assume that you have considered more outcomes than I have. Because, from my five minutes of reflection as a software geek, albeit with a passion for history, I find this the most surprising thing about the whole project.

I suspect restricting access could equally be a comment on modern LLMs in general, rather than the historical material specifically. For example, we must be constantly reminded not to give LLMs a level of credibility that their hallucinations would have us believe.

But I'm fascinated by the possibility that somehow resurrecting lost voices might give an unholy agency to minds and their supporting worldviews that are so anachronistic that hearing them speak again might stir long-banished evils. I'm being lyrical for dramatic affect!

I would make one serious point though, that do I have the credentials to express. The conversation may have died down, but there is still a huge question mark over, if not the legality, but certainly the ethics of restricting access to, and profiting from, public domain knowledge. I don't wish to suggest a side to take here, just to point out that the lack of conversation should not be taken to mean that the matter is settled.

I'm not sure I do. It feels like someone might for example have compiled a full library of books, newspapers and other writing from that era, only to then limit access to that library, doing the exact censorship I imagine the project was started to alleviate.

Now were it limited in access to ask money to compensate for the time and money spent compiling the library (or training the model), sure, I'd somewhat understand. Not agree but understand.

Now it just feels like you want to prevent your model name being associated with the one guy who might use it to create a racist slur Twitter bot. There's plenty of models for that already. At least the societal balance of a model like this would also have enough weight on the positive side to be net positive.

There's no such risk so you're not going to get any sensible ideas in response to this question. The goals of the project are history, you already made that clear. There's nothing more that needs to be done.

We all get that academics now exist in some kind of dystopian horror where they can get transitively blamed for the existence of anyone to the right of Lenin, but bear in mind:

1. The people who might try to cancel you are idiots unworthy of your respect, because if they're against this project, they're against the study of history in its entirety.

2. They will scream at you anyway no matter what you do.

3. You used (Swiss) taxpayer funds to develop these models. There is no moral justification for withholding from the public what they worked to pay for.

You already slathered your README with disclaimers even though you didn't even release the model at all, just showed a few examples of what it said - none of which are in any way surprising. That is far more than enough. Just release the models and if anyone complains, politely tell them to go complain to the users.

Yet your project relies on letting an llm synthesize historical documents and presenting itself as some sort of expert from the time? You are aware of the hallucination rates surely but don't care whether the information your university presents is accurate or are you going to monitor all output from your llm?

What are the legal or other ramifications of people misrepresenting the goals of your project? What is it you're worried about exactly?

This is understandable and I think others ITT should appreciate the legal and PR ramifications involved.

A disclaimer on the site that you are not bigoted or genocidal, and that worldviews from the 1913 era were much different than today and don't necessarily reflect your project.

Movie studios have done that for years with old movies. TCM still shows Birth of a Nation and Gone with the Wind.

Edit: I saw further down that you've already done this! What more is there to do?

[flagged]

i think it's fine, thank these people for coming up with the idea and people are going to start doing this in their basement then releasing it to huggingface

You "misuse" it by using it to get at truth and more importantly historical contradictions and inconsistencies. It's the same reason catholic church kept the bible from the masses by keeping it in latin. The same reason printing press was controlled. Many of the historical "truths" we are told are nonsense at best or twisted to fit an agenda at worst.

What do these people fear the most? That the "truth" they been pushing is a lie.

Its output might violate speech codes, and in much of the EU that is penalized much more seriously than violent crime.

Ask it to write a document called "Project 2025".

To get a single knowledge-cutoff they spent 16.5h wall-clock hours on a cluster of 128 NVIDIA GH200 GPUs (or 2100 GPU-hours), plus some minor amount of time for finetuning. The prerelease_notes.md in the repo is a great description on how one would achieve that

Such as?