Comment by simonw
2 days ago
The Matryoshka trick is really neat - there's a good explanation here: https://huggingface.co/blog/matryoshka
I've seen it in a few models now - Nomic Embed 1.5 was the first https://www.nomic.ai/blog/posts/nomic-embed-matryoshka
OpenAI did it a few weeks earlier when they released text-embedding-3-large, right?
Huh, yeah you're right: that was January 25th 2024 https://openai.com/index/new-embedding-models-and-api-update...
Nomic 1.5 was February 14th 2024: https://www.nomic.ai/blog/posts/nomic-embed-matryoshka