Comment by OutOfHere
6 months ago
Modern embeddings lie on a hypersphere surface, making euclidean equal to cosine. And if they don't, I probably wouldn't want to use them.
6 months ago
Modern embeddings lie on a hypersphere surface, making euclidean equal to cosine. And if they don't, I probably wouldn't want to use them.
True, on a hypersphere cosine and euclidean are equivalent.
But if random embeddings are gaussian, they are distributed on a "cloud" around the hypersphere, so they are not equal.