Comment by hugoba

this model is fire.

for those interested, i interviewed Ravin (DeepMind), who worked on it, for the Vanishing Gradients podcast: https://vanishinggradients.fireside.fm/56

Video on YT here: https://youtu.be/VZDw6C2A_8E?si=XLUzNRQzeloB9rki

Disclaimer: The Gemma family rock!