Comment by Scene_Cast2

2 months ago

RoPE is somewhat related, I think, and it's pretty popular.

There's also 2D rope for ViT, but I don't know how it works exactly.