Comment by gitpusher42
7 hours ago
It is super cool! Diffusion Gemma was released around the middle of my project, and I seriously considered switching to it. But I decided to finish the project as it was.
I believe it would be a perfect match!
Feel free to use any parts of my project or drop me a message. There’s my LinkedIn link at the end of the readme. Or I will drop you a message later!
Awesome. I may need to finally bite the bullet and upgrade my macOS to test out the MPP approach you've taken.
I've got a number of tiled-load kernels, and a top-k attention kernel that you might find interesting.