← Back to context

Comment by nbardy

2 days ago

I hate to be pedantic, but the llm is definitely doing embedding math. In fact that’s all it does.

Sure! Although I think we both agree that the way those embeddings are transformed is significantly different ;)

(what I meant to say is that it doesn't do embedding math "LIKE" the OP — not that it doesn't do embedding math at all.)

  • Yeah we'd be impressed if an LLM calculated the product of a couple of 1000x1000 matrices.