Comment by polotics

yep "next-embedding" predictor is more correct, and not just at the end but through the layers, and folding back dimensions into that one next token is one small final step, and next-embedding could be named "next-meaning" as well, and we're getting there...

this sentence above would made a longer article if I bothered to so blog as is being blogged here