Comment by Scene_Cast2

2 days ago

RoPE is somewhat related, I think, and it's pretty popular.

There's also 2D rope for ViT, but I don't know how it works exactly.