Someone’s surely doing it atm we just don’t know yet. And then we scan all books but the stuff stays local. Perhaps possible, perhaps not. But I don’t see why everyone could not run given the epoch on his content only, reporting back findings (loss).
Covenant-72B
https://arxiv.org/abs/2603.08163
https://huggingface.co/1Covenant/Covenant-72B
Someone’s surely doing it atm we just don’t know yet. And then we scan all books but the stuff stays local. Perhaps possible, perhaps not. But I don’t see why everyone could not run given the epoch on his content only, reporting back findings (loss).
There is a Swiss model by ETH university completely trained on fair and open data that everybody can use and is from top to bottom open source.
https://www.swiss-ai.org/apertus Is the model in question
is it mathematically viable ? (aka no regression)
Training neural networks is requires extremely high speed interconnect between the humongous GPUs