Comment by n2d4

2 days ago

Sure! Although I think we both agree that the way those embeddings are transformed is significantly different ;)

(what I meant to say is that it doesn't do embedding math "LIKE" the OP — not that it doesn't do embedding math at all.)

Yeah we'd be impressed if an LLM calculated the product of a couple of 1000x1000 matrices.