Comment by belter
2 days ago
"...EuroLLM-9B was trained on approximately 4 trillion tokens, using 400 Nvidia H100 GPUs on the MareNostrum5 supercomputer..."
2 days ago
"...EuroLLM-9B was trained on approximately 4 trillion tokens, using 400 Nvidia H100 GPUs on the MareNostrum5 supercomputer..."
Related: MareNostrum5 is part of the eurohpc some bashed in other comments.
Not related: it's in a church in Barcelona, I wanted to visit it but when I went to Barcelona it was closed for holidays so they didn't do visited tours. I also discovered the 5th most powerful supercomputer is by Italian energy company ENI, of all the companies that could have been I wouldn't have never expected an energy company to have such a powerful supercomputer (the first 3 are usa labs supercomputers, the 4th is a Microsoft supercomputer)