Comment by mynti 1 day ago For anyone curious about what the Gated Delta Network is: https://arxiv.org/pdf/2412.06464 1 comment mynti Reply yorwba 1 day ago Also, Gated Attention: https://arxiv.org/abs/2505.06708
Also, Gated Attention: https://arxiv.org/abs/2505.06708