Training State-of-the-Art Sentence Embedding Models
Detailed talk about how to train state-of-the-art sentence embedding models.
The talks does a deep-dive on the Multiple-Negatives-Ranking-Loss:
https://www.sbert.net/docs/package_re...
the best method to train sentence embedding models.
It covers many details how to further improve the performance.
For an introduction to sentence embedding models / dense text representations, I recommend these videos:
• Introduction to Dense Text Representa...
Slides: https://sbert.net/_static/talks/2021-...
The talk was given as part of the Hugging Face JAX / Flax Community event to train sentence embedding models on 1B+ train examples:
https://discuss.huggingface.co/t/trai...
JAX / Flax Community event: https://discuss.huggingface.co/t/open...